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A. A copy of U.S. Patent No. 6,006,265 issued to Rangan. 

B. A copy of U.S. Patent No. 5,155,591 issued to Wachob. 
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I. REAL PARTY IN INTEREST 

The inventor of the above-noted patent application has assigned all respective rights in 
relation to the invention entitled "METHOD AND APPARATUS FOR BROADCASTING 
INFORMATION OVER A NETWORK" including any resulting patent, to U.S. West, Inc., a Delaware 
corporation formerly with a place of business in Denver, Colorado. This assignment was for the 
parent U.S. Patent Application No.09/322,375 (Now U.S. Patent No. 6,411,992 issued June 25, 
2002) of the above noted patent application (i.e., a continuation patent application) and was 
recorded at the U.S. Patent Office on Aug. 27, 1999 at Reel 010196, Frame 0922. This invention, 
including any resulting patent, was then assigned by U.S. West, Inc. to Qwest Communications 
International Inc., a Delaware corporation with a place of business in Denver, Colorado, in the 
Assignment that was recorded at the U.S. Patent Office on September 25, 2000 at Reel 010814, 
Frame 0339. These assignments were subsequently recorded for the above noted patent application 
at the U.S. Patent Office on Jan. 2, 2007 at Reel 018698, Frame 0929 and at Reel 018698, Frame 
0949. Therefore, Qwest Communications International Inc. is the real party in interest in this 
appeal. 
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II. RELATED APPEALS AND INTERFERENCES 



Appellant, Appellant's legal representative, the assignee of the above-noted patent 
application, and the named inventors for the above-noted patent application are all unaware of any 
appeal(s) or interference(s) which will directly affect, be directly affected by, or have a bearing on 
the Board's decision in the pending appeal. 



4 



III. STATUS OF CLAIMS 

The status of the claims is as follows: 

1. Claims cancelled: 7, and 12 - 21 ; 

2. Claims pending: 1 - 6, 8 - 1 1 and 22 - 25; 

3. Claims rejected: 1 - 6, 8 - 1 1 and 22 - 25; and 

4. Claims appealed: 1 - 6, 8 - 1 1 and 22 - 25. 
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IV. 



STATUS OF AMENDMENTS (37 CFR $ 1.192(c)(4)) 



The Applicant filed U.S. Patent Application No. 10/001,662 on Oct. 18, 2001. The 
application contained 21 total claims, 2 of which (Claims 1 and 12) were independent claims. The 
Applicant received a Non Final Office Action mailed Jan. 29, 2003 (the "First Non Final Office 
Action"), wherein Claims 1-11 were rejected by the original Examiner under 35 U.S.C. § 101. 
Claims 1-21 were also rejected under 35 U.S.C. § 1 12, first paragraph and second paragraph. 
Claims 1 through 21 were also rejected under 35 U.S.C. § 102(b) as being anticipated by U.S. 
Patent No. 4,331,974 (issued May 25, 1982), U.S. Patent No. 5,155,591 (issued Oct. 13, 1992; 
hereafter "Wachob"), U.S. Patent No. 5,446,919 (issued Aug. 29, 1995), U.S. Patent No. 5,515,098 
(issued May 7, 1996), U.S. Patent No. 5,661,516 (issued August 26, 1997); or U.S. Patent No. 
5,600,364 (issued Feb. 4, 1997) and under 35 U.S.C. § 102(e) as being anticipated by WO 99/46708 
(published September 16, 1999), U.S. Patent No. 6,006,265 (issued Dec. 21, 1999; hereafter 
"Rangan"), WO 00/17775 (published Mar. 30, 2000), or U.S. Patent No. 6,298,348 (issued Oct. 2, 
2001). Claims 1 - 21 were also rejected under 35 U.S.C. § 103(a) as being unpatentable over the 
Examiner's personal experience in NFL Super Bowl advertising. The Applicant filed an 
Amendment and Response on June 30, 2003 amending claims 1, 2, 4, 8, 9, 1 1 - 14, 17, and 1 8, 
cancelling claims 7 and 20 to address informalities, and arguing the distinctions in the claims as 
compared to the above cited references. 

The Applicant received a Final Office Action mailed on August 25, 2003 (the "First Final 
Office Action") rejecting claims 2, 10, and 15 for various informalities and rejecting claims 1 - 6, 8 
- 11, 13 through 19, and 21 under 35 USC § 101 for previously recited reasons. The Examiner also 
maintained the rejections of claims 1 - 6, 8 - 19, and 21 under 35 U.S.C. § 112, first paragraph and 
second paragraph, 35 U.S.C. § 102, and 35 U.S.C. § 103(a). The Applicant filed a Request for 
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Continued Examination and a Preliminary Amendment therewith on October 24, 2003 amending 
claims 1,3-6, canceling claims 12-21, and adding new claims 22 -25. On January 18, 2006, 
newly assigned Examiner Raquel Alvarez mailed aNon Final Office Action (the "Second Non 
Final Office Action") rejecting claims 1 - 6 and 8-25 (even though claims 12-21 were already 
cancelled) under 35 USC § 103(a) as being unpatentable over Rangan, et al. in view of Wachob, 
although claims 8-21 were no longer pending. The Applicant amended claims 1 and 6 to correct 
informalities on May 18, 2006 and traversed each of the Examiner's rejections including those 
which the Examiner never articulated. In a Final Office Action mailed August 1 1 , 2006 (the 
"Second Final Office Action"), the Examiner maintained the rejections to claims 1 - 6 and 8 - 25 
under 35 U.S.C. § 103(a) and summarily dismissed the Applicant's arguments and the Applicant's 
contentions that she did not address the claims. The Applicant responded to the Second Final 
Office Action on October 11, 2006, traversing the Examiner's rejections to claims 1 - 6, 8 - 1 1, and 
22 - 25 without amending. In response, the Examiner mailed an Advisory Action on October 20, 
2006 stating that the application was still not in condition for allowance. A Notice of Appeal was 
filed by the Applicant on November 13, 1006 and this Appeal Brief is the result thereof. 
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V. 



SUMMARY OF CLAIMED SUBJECT MATTER 



Claim Group A: Claims 1 - 6, 8 - 1 1, and 24. 

Generally, the Group A claims of the present invention relate to transmitting digital media 
from a network server over a data network while providing the ability to determine demographic 
information of a user who receives the digital media such that commercial content can be inserted 
into the digital media according to the demographic information. See e.g., page 9, lines 7 - 10 of the 
present application. For example, a system user accessing the Internet may select a digital media 
presentation via a hypertext link. See e.g., page 11, lines 4 - 9 of the present application. The user's 
IP address may be conveyed to the network server such that the digital media can be delivered to 
the user. The IP address may then be used to retrieve demographic information pertaining to the 
user (e.g., the IP address may be representative of a particular user(s) on the internet fitting a certain 
demographic profile). See e.g., page 15, lines 13-18 and page 19, lines 16 - 22 of the present 
application. A commercial can then be selected based on the demographic information for insertion 
to the digital media during a commercial break for transmission to the system user. See e.g., page 
16, lines 3-23 and page 19, lines 8 - 15 of the present application. The invention also includes 
means for acquiring the demographic information via inputs by the system user or monitoring of the 
system user's selections to determine a demographic profile. For example, observations of a user 
clicking on various hypertext links at an ESPN website may be used to associate the user with a 
demographic profile of a male between the ages of 25 and 45. 

Additionally, the invention includes the detection of system users log into a network and 
identifying those users connected to the broadcast server to access a database and retrieve their 
demographic information. See e.g., lines 21 - 23 of page 15 of the present application. For 
example, identification of the user may be performed by reading the IP address of the user or 
reading a login ID of the user. See e.g., page 9, lines 7 - 9 of the present application. Multimedia 
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information may then be broadcast to the server over the data network to the system users. See e.g., 
page 16, lines 3 - 7 of the present application. For example, the information may be broadcast 
during a detected commercial break based on demographic information such that commercials may 
be retrieved based on that demographic information. See e.g., page 19, lines 12 - 14 of the present 
application. The commercials may then be simultaneously broadcast based on the demographic 
information. See e.g., page 11, line 18 - page 12, line 3 of the present application. 

The multimedia information may be data stored in memory or a live program received from 
a remote source. See e.g., Figure 1 and page 10, lines 22 - 25 of the present application. The 
invention may further include monitoring system users to accumulate additional demographic 
information, such as age of the user, sex of the user, and geographic location of the user. See e.g., 
page 7, lines 21-23 and page 9, lines 7 - 10 of the present application. Such demographic 
information may be queried from the user page 9, lines 7 - 10 of the present application. The 
commercials may be inserted during commercials breaks (e.g., ad hoc commercial breaks). See e.g., 
page 1 0, lines 11-19 and page 16, lines 3 - 14 of the present application. The invention may also 
include presenting an interactive component in the broadcast of the commercial and retrieving 
additional information based on a user's response. See e.g., page 4, lines 2 - 8 of the present 
application. 

Claim Group B: Claims 22, 23, and 25. 

Generally, the Group B claims of the present invention relate to a system that provides for 
the transmission of multimedia information over a data network (e.g., World Wide Web of page 2, 
lines 15 - 16 of the present application) in a manner similar to that described in the Group A claims. 
For example, a network server may be used for transmitting digital media from a network server 
over a data network while providing the ability to determine demographic information of a user who 
receives the digital media such that commercial content can be inserted into the digital media 
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according to the demographic information. See e.g., page 9, line 7 - 10 of the present application. 
A system user accessing the Internet may select a digital media presentation via a hypertext link. 
The user's IP address may be conveyed to the network server such that the digital media can be 
delivered to the user. The IP address may then be used to retrieve demographic information 
pertaining to the user (e.g., the IP address may be representative of a particular user(s) on the 
internet fitting a certain demographic profile). See e.g., page 15, lines 13 through 18 of the present 
application. A commercial can then be selected based on the demographic information for insertion 
to the digital media during a commercial break. See e.g., page 16, lines 3-23 and page 19, lines 8 
- 15 of the present application. Additionally, the invention includes means for acquiring the 
demographic information via inputs by the system user or monitoring of the system user's 
selections to determine a demographic profile. For example, observations of a user clicking on 
various hypertext links at an ESPN website may be used to associate the user with a demographic 
profile of a male between the ages of 25 and 45. 

More specifically, the system includes a network interface that establishes connections with 
the system users over the data network. See e.g., page 7, lines 14 - 22 of the present application. 
The system also includes a schedule database which stores multimedia schedules and screen 
displays that are presentable to system users for entering demographic information. See e.g., page 
9, lines 2 - 4 of the present application. The system also includes a program source, such as a 
broadcaster broadcasting television programs or a database for maintaining multimedia information. 
See e.g., Figure 1, page 7, line 19 - page 8, line 2 of the present application. The system also 
includes a commercial database for storing commercials that are transmitted to users based on the 
demographic information. See e.g., page 12, lines 8 - 1 1 of the present application. The system 
also includes a processor that retrieves multimedia information based on the schedules for 
transmission to users through the network interface. The processor also selects commercials based 
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on the demographic information. See e.g., page 8, line 16 - page 9, line 1 1 of the present 
application. 
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VI. GROUNDS OF REJECTION TO BE REVIEWED O N APPEAL 

1. Claims 1 - 6, 8 - 1 1, and 22 - 25 have been rejected under 35 U.S.C. § 103(a) as being 
unpatentable over Rangan (i.e., U.S. Patent No. 6,006,265) in view of Wachob (i.e., U.S. Patent No. 
5,155,591). 
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VII. ARGUMENTS 
Claim Group A 

The Examiner rejected claims 1 - 6, 8 - 1 1, and 22 - 25 under 35 U.S.C. § 103(a) as being 
unpatentable over Rangan in view of Wachob, in the Second Non Final Office Action mailed 
January 1 8, 2006 without addressing all of the claims. In the Second Non Final Office Action, the 
Examiner merely argued how Rangan and Wachob obviate certain limitations in the independent 
claims (i.e., claims 1 and 22). When the Applicant brought this failure to address all of the claims 
to the Examiner's attention, the Examiner issued a Final Office Action simply stating that all claim 
limitations were addressed in the Non Final Office Action mailed on May 22, 2006. The 
Examiner's communication on May 22, 2006, however, was an interview summary in which no 
rejections were discussed. The Applicant considered the Examiner's assertion as meaning that all 
claim limitations were addressed in the Second Non Final Office Action with a mailing date of 
January 18, 2006. However, the Applicant maintains that the Examiner merely rejected all claims 
and only addressed claim limitations associated with claims 1 and 22 and did not even address each 
independent claim element correctly. That is, the Examiner did not point out where all of the claim 
elements of claims 1 and 22 are taught. 

As one example of the Examiner's erroneous rejection, the Examiner rejected claim 1 by 
stating that Rangan, at column 20, lines 52 - 60, teaches the claimed steps of receiving through a 
screen display demographic information for the system user and using the IP address to access a 
database and retrieve demographic information that is associated with the system user. Elowever, 
Rangan instead merely states that a client subscriber/user/viewer (SUV) may click to a hyper video 
commercial to initiate a Web transaction (column 20, lines 49 and 50 of Rangan) and that the 
feedback from the transaction results in on-the-fly commercial insertion that may be tuned to local 
demographic conditions and user profiles. Nowhere does Rangan state that demographic 
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information for a system user is received through a screen display. In fact, Rangan does not 
mention or even suggest a screen display for entering demographic information in any form. 

The claimed display allows the user to enter demographic information so that preferable 
commercials may be inserted into the multimedia presentation. The demographic information of 
the Applicant's claims originates from system users who have logged on and provided certain 
demographic information about themselves. This information is stored within a database which 
allows the programmer to ascertain a particular audience according to the demographic information 
and subsequently select commercials that are based on that demographic information. See e.g., 
page 9, lines 5 - 24, page 10, lines 1 - 19 of the present specification. Rangan, on the other hand, 
teaches the automatic analysis of streaming video and the insertion of hotspots over hyperlinks to 
make hypervideo. Column 17, lines 49 - 53 of Rangan. While Rangan is certainly a challenging 
reference to comprehend, the Applicant finds no teaching or reasonable suggestion regarding the 
entrance of demographic information through a screen display as the Applicant claims. 

Regardless, Rangan's mere statement of commercial insertion in column 20, line 55 is not 
the same as the commercial transmission of a retrieved commercial during a commercial break. 
Rather, Rangan's alleged teaching of a commercial insertion generally regards insertion of hypertext 
links within video content to make "hypervideo", which allows a user to select additional video 
content during presentation of the hypervideo. For example, Rangan explicitly states that "in 
accordance with the present invention, the insertion is not of clips... but rather of hyperlinks", 
column 20, lines 15-22. The specification of Rangan is fraught with explicit references stating that 
insertion is in the context of hyperlinks that are associated with commercials. See e.g., column 18, 
lines 51-59. This differs from the Applicant's claims because, among other reasons, the Applicant 
claims the insertion of commercials based on demographic information as opposed to the insertion 
of hyperlinks. 
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Additionally, the Examiner cited In re Keller, 642 F.2d 413, 208 (C.C.P.A. Feb. 1981) 
stating that the Applicant argues against the references individually and that one cannot show 
obviousness by attacking references individually where the rejections are based on combinations of 
references; the Examiner's understanding of In re Keller is fundamentally wrong. In re Keller and 
its progeny does relate to an Applicant's arguments in favor of patentability over an obviousness 
rejection (i.e., § 103(a)) based on a combination of references, as in the present application. 
However, In re Keller showed that the Applicants stipulated that every element of the Applicant's 
claims were taught by the combined references. The Applicants in that case chose to argue that the 
cited references were not combinable because they were not analogous. More specifically, the 
Applicant argued that a secondary reference, which included one claim element (i.e., a digital 
timing circuit) within a teaching of mammalian heart stimulation was not combinable with a 
primary reference, which included all of the Applicant's claim elements except for a digital timing 
circuit within a teaching of cardiac pacing. The Applicant there still claimed an analog timing 
circuit that was easily replaceable with the digital timing circuit of the secondary reference. This 
differs from the present case because the Applicant here is only stating other features that the 
primary reference does not teach. In other words, the cited references do not teach all of the 
Applicant's claim elements as required and as the Applicant maintains. 

To illustrate, the Examiner stated that Rangan teaches the Applicant's element of receiving 
through a screen display demographic information for the system user and using the IP address to 
access a database and retrieve demographic information that is associated with the system user. The 
Applicant pointed out that Rangan does no such thing. Rangan does not teach receiving 
demographic information through a screen display. The Applicant then pointed out what one 
skilled in the art would understand Rangan to be teaching, to illustrate the differences between what 
the Examiner asserted and what the Applicant claims. Thus, the Applicant has shown that Rangan 
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does not teach all of the Applicant's claim elements as the Examiner suggests. As is well known, 
"all elements of the claim must be found in the reference". In re Royka, 490 F.2d 981 (C.C.P.A. 
1974). See also, M.P.E.P. § 2143.03. 

The Examiner also stated that Rangan does not specifically teach detecting a commercial 
break but that Wachob does. The Applicant agrees that Rangan does not teach detecting a 
commercial break; but neither does Wachob. The Examiner pointed to Figure 3 of Wachob to state 
that Wachob teaches detecting a commercial break. In Figure 3, Wachob teaches reading tag 
information that is transmitted by the system head (box 1 50). For example, Wachob states that 
"[t]he tag information defines if and when a commercial is about to occur, how long it will last, and 
which channel the converter should tune to". Column 7, lines 13-21 of Wachob. Nothing in this 
reference suggests detection; rather, the information is provided by the headend. 

Regardless, Wachob is not analogous art. Rangan teaches selection of hypertext links within 
video content for distribution over the Internet. Wachob teaches commercial insertion during 
predetermined times via cable television (see e.g., column 4, lines 30-35 of Wachob). The types of 
content are totally different. That is, Rangan delivers audio and/or video content digitally via 
Internet protocols through an Internet network (see e.g., Figure 1 and column 24, lines 32-51 of 
Rangan), whereas Wachob delivers audio and/ or video content in an analog fashion via radio 
frequency AM or FM modulation schemes (see e.g., Figure 1 and column 4, lines 56 - 68 and 
column 1-7 of Wachob). Such analysis is inconsistent with the reasonableness standard stated in 
In re Oetiker, 977 F.2d 1443, 1447 (C.A.Fed.,1992) (stating "it is necessary to consider the reality 
of the circumstances. . . - in other words, common sense - in deciding in which fields a person of 
ordinary skill would reasonably be expected to look for a solution to the problem facing the 
inventor. See also MPEP § 2141.01(a). 
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Even if the two references were combinable, there is simply no motivation to combine. For 
example, Wachob is specifically related to delivering content to a cable television user via the 
converter (a.k.a. a set-top-box) of Figure 1 in conjunction with the remote control of Figure 2. 
Rangan does not teach or reasonably suggest the use of such boxes because all of Rangan's 
communications are performed via computers through the Internet. Additionally, there has to be 
some reasonable expectation of success in the combination. See In re Merck & Co., Inc., 800 F.2d 
1091, 231 USPQ 375 (Fed. Cir. 1986). See also M.P.E.P. § 2143.02. There is no reasonable 
expectation of success because one cannot simply "jam" analog content through the internet by 
means of an analog cable TV box. Reasonableness aside, there is simply no way to combine 
Rangan and Wachob and expect the combination to work because Rangan is directed to the Internet 
and Wachob is directed to conventional television - two vastly different forms of communication. 
Rangan even expresses this fact, at column 29, lines 39 - 42, where it states that its teachings are 
"in marked contrast to conventional broadcast television where there is no interactivity with the 
viewer and/or the viewers video playback, especially including commercials." 

Because neither Rangan nor Wachob teach or reasonably suggest all of the Applicant's 
claim elements either alone or in combination, and because Rangan and Wachob are not 
combinable, the Applicant maintains that claim 1 is novel and non obvious in view of the cited 
references. 

Other examples of the Examiner's negligee shoddy examination are found in the rejections 
of claims 2-6 and 8-11. For example, in the Second Non Final Office Action, the Examiner 
never addressed the broadcasting multimedia information of claim 2, the monitoring of system users 
of claim 4, the querying of system users of claim 9, the presenting of an interactive component of 
claim 10, or the reading of an IP address of claim 11. These dependent claims were simply lumped 
together in the rejections of the associated independent claim 1 without these limitations ever being 
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addressed. Claims should never be grouped together in a common rejection, unless that rejection is 
equally applicable to all claims in the group. M.P.E.P § 707.07(d). The Applicant maintains that 
the rejection clearly cannot apply to all of the claims because the elements of the dependent claims 
recite unique features that are not recited in the patentable independent claim. The Examiner should 
have issued another non final office action to address these claims as the Applicant requested. 
Instead, the Examiner only addressed these limitations in the Second Final Office Action and 
applied similarly incorrect logic in the rejections thereof. 

The Applicant maintains that Rangan does not teach monitoring a system user' s computer to 
accumulate demographic information as claimed by the Applicant in claim 4. In fact, Rangan 
explicitly teaches away from this claim limitation when Rangan states "[t]his knowledge is not 
gained by any sort of insidious monitoring of the Client SUVs. Instead, it should be recognized that 
the Client SUVs from time to time identify, and link, to the (hyper)video that each wishes to view." 
Column 18, lines 7-11 of Rangan. For the first time in the Second Final Office Action, the 
Examiner stated that Rangan does teach monitoring a system user's computer to a cumulative 
demographic information at column 29, lines 35 - 39. Here, Rangan states that an advertiser may 
develop statistics on "click-throughs". A click-through, as is known to those skilled in the art, is 
obtained from users who "click" on a web page. Such is analogous to monitoring your own 
website to determine how many other people "click" on your website. This, however, does not 
constitute monitoring another person 's computer as the Applicant claims. For at least these 
reasons, claim 4 is allowable and such disposition is respectfully requested. 

As Examiner has pointed out, Rangan does not teach detecting a commercial break; but, 
neither does Wachob. In claim 5, the Applicant claims an ad hoc commercial break. The ad hoc 
commercial break of the Applicant's claims is a type of commercial which may be shown during a 
program which has a number of nondesignated commercial breaks (e.g., sporting events with 
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unpredictable timeouts). Page 10, lines 15-19 of the present application. The Applicant has 
already shown that Wachob does not teach detection of a commercial break. As such, Wachob 
cannot teach detection of an ad hoc commercial break. In fact, Wachob has no teaching or 
reasonable suggestion regarding any type of unpredictable commercial break detection. Since 
Wachob does not teach or reasonably suggest an ad hoc commercial break detection and since 
Rankin admittedly does not, claim 5 must be allowable in such disposition is respectfully requested. 

Claim 9 recites a step of querying a system user to provide the demographic information 
when the system user logs on to the network server. Neither Rangan nor Wachob teach or 
reasonably suggest querying a user for demographic information when the system user logs on to 
the network server as the Applicant claims in claim 1 . Rather, Rangan only states that demographic 
information is used without making reference to how the information is acquired. Wachob, on the 
other hand, states that information is provided by means of a remote control or "household survey" 
(see e.g., column 1, lines 48 - 64 of Wachob) without teaching or reasonably suggesting any type of 
querying of a system user being performed by the network, particularly when the system user logs 
on to the network. That is, Wachob 's users input data to a system without regard to any query. 
Since Rangan and Wachob neither teach nor reasonably suggest querying of the system user for 
demographic information when the system user logs on, the cited references are simply insufficient 
in nullifying the patentable features of the Applicant's claim. For at least these reasons, claim 9 is 
allowable in view of the cited references and the Applicant, therefore, respectfully requests such 
disposition. 

Rangan and Wachob also do not teach or reasonably suggest receiving a login ID from a 
system user, either alone or in combination, as the Applicant claims in claim 1 1. In fact, Wachob is 
essentially precluded from doing so because the non-analogous art of Wachob is directed towards 
cable television and not the network servers associated with the Internet of the Applicant's claims 
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(e.g., cable television users do not log on to their set top boxes). The Examiner first addressed this 
claim in the Second Final Office Action nakedly arguing that Rangan teaches a login. The 
Applicant has made a thorough search of Rangan and finds no such teaching or even any form of 
the word "log". Since neither Rangan nor Wachob teach or reasonably suggest receiving a login ID 
as the Applicant claims, claim 1 1 is allowable in view of these references in such disposition is 
respectfully requested. 

The Applicant has shown how the above-mentioned claims are allowable in view of the 
cited references. Accordingly, the Applicant respectfully requests allowance of these claims. 

Claim Group B 

As mentioned, the invention of the group B claims is similar to that of the group A claims; 
but these claims require other additional features. In this regard, the Examiner rejected claim 22 
based on Official Notice because stating that it is old and well known "to schedule when certain 
information is to be scheduled in order to designate a fixed time for an event". Even if true, the 
Examiner still failed to address where a schedule database stores one or more screen displays which 
are presentable and through which the system users enter demographic information. Moreover, the 
Applicant cannot even fully comprehend the Examiner's rejection because Examiner rejected claim 
22 based on Rangan and Wachob. The Applicant maintains that neither Rangan nor Wachob teach 
or reasonably suggest such storage. The Applicant further maintains that it is not well-known to 
those skilled in the art to provide a schedule database that stores one or more screen displays which 
are presentable and through which the system users enter demographic information. Accordingly, 
the Applicant believes claim 22 is allowable and respectfully requests such disposition. 

Regarding the Examiner's Official Notice, it has been held that an Examiner cannot simply 
"pick and choose" elements to depreciate the claimed invention as such would be hindsight. See 
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e.g., In re Fine, 837 F.2d 1071, 1075 (C.A.Fed., 1988); see also, M.P.E.P. § 2143.03. The 
Applicant pointed out that such a schedule database is not well-known or old and demanded proof 
of such an assertion. The Examiner stated, however, that the Applicant did not properly challenge 
the Examiner's official notice and cited "In re Boon" at M.P.E.P. § 2144.03. There is no such 
citation at M.P.E.P. § 2144.03. Regardless, to adequately traverse "Official Notice", an Applicant 
is required to specifically point out the supposed errors in the Examiner's action, which would 
include stating why the noticed fact is not considered to be common knowledge or well-known in 
the art. M.P.E.P. § 2144.03. The Applicant stated that the claimed scheduling database is used to 
store data pertaining to scheduling. Storing screen display data in a scheduling database would 
essentially be storing data other than what a typical database w r ould be originally configured for. 
Accordingly, the Applicant respectfully requests withdrawal of the Examiner's Official Notice. 

As with the dependent claims of claim 1 , the Examiner also failed to individually address 
claims 23 - 25. For example, the Examiner never addressed the program source of claim 22 or the 
simultaneous transmission of claim 24. These dependent claims were also lumped together in the 
rejections of the associated independent claim 22, which the Applicant maintains is impermissible 
because the rejection is not equally applicable to all claims in the group. See M.P.E.P § 707.07(d). 
The Applicant pointed out the Examiner's failure to address each claim in the Second Non Final 
Office Action and requested a new Non Final Office Action, which the Examiner summarily 
dismissed. The Applicant maintains that claims 22 - 25 are allowable in view of the cited 
references and, therefore, respectfully requests such disposition. 
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VIII. CLAIMS APPENDIX 

1 . A method of transmitting multimedia from a network server information over a data 
network comprising the steps of: 

detecting at least one system user logged into a network server through a connection 
established over the data network from a remotely located computer and identifying an IP address 
associated with the connection of the remotely located computer with the network server, and 
presenting one or more hypertext links which are selectable so as to view a selected multimedia 
presentation; 

receiving through a screen display demographic information for the at least one system user; 

using the IP address to access at least one database to retrieve demographic information 
stored therein associated with the at least one system user; 

based on the selected hypertext link accessing the selected multimedia presentation in a 
computer memory and transmitting the selected multimedia presentation information from the 
network server over the connection to the remotely located computer; 

detecting an inserted commercial break during the transmission of the multimedia 
presentation over the connection; 

based on the demographic information associated with the at least one system user, 
accessing a commercial database and retrieving at least one commercial associated with the 
demographics for the at least one system user; and 

transmitting the retrieved commercial to the at least one system user over the connection 
during the commercial break. 

2. The method of claim 1 further comprising the step of: 

detecting a plurality of system users logged into the network server over the data network; 
22 



identifying each of the plurality of system users connected to the broadcast server and 
accessing the at least one database to to retrieve demographic information stored in first memory for 
each of the plurality of system users 

broadcasting the multimedia information from the broadcast server over the data network to 
the plurality of system users; 

detecting a commercial break during broadcasting of the multimedia information; 

retrieving from memory plurality of commercials, each of which is associated with the 
demographic information of one of the plurality system users; 

during the commercial break, simultaneously broadcasting the plurality of commercials, 
wherein each of the commercials in the plurality of commercials is broadcast to a system user 
within the plurality of system users with the demographic information associated with the 
commercial. 

3. The method of claim 1 wherein the multimedia information comprises at least one 
of: a data stored in memory and a live program received from a remote source. 

4. The method of claim 1 further comprising the step of monitoring the at least one 
system user receiving the multimedia presentation and accumulating additional demographic 
information for the multimedia presentation. 

5. The method of claim 4 wherein the step of detecting a commercial break is 
performed for ad hoc commercial breaks. 
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6. The method of claim 1 further comprising the step of identifying one or more 
appropriate commercials based on the time available during an identified commercial break. 

Claim 7 (Cancelled) 

8. The method of claim 7 wherein the demographic information includes at least one of: 
age of the at least one system user, sex of the at least one system user, and geographic location of 
the at least one system user. 

9. The method of claim 1 further comprising the step of querying the least one system 
user to provide the demographic information when the at least one system user logs onto the 
network server. 

10. The method of claim 1 further including the step of presenting an interactive 
component in the broadcast of the at least one commercial whereby additional information may be 
retrieved from the memory based on the at least one system user's response to the interactive 
component. 

1 1 . The method of claim 1 wherein the step of identifying the at least one system user 
comprises at least one of: reading the LP. address the at least one system user logged into the 
network server and receiving a login ID from the at least one system user upon logging into the 
network server. 

Claims 12-21 (Cancelled) 
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22. A network server configured for transmitting multimedia information over a data 
network comprising: 

a network interface in communication with a data network, said network interface 
configured to establish one or more connections with systems user connecting with the network 
server over the data network; 

a schedule database within which is stored one or more schedules for the multimedia 
information as well as one or more screen displays which are presentable and through which the one 
or more system users enter demographic information; 

a program source from which the multimedia information included listed in the one may be 
retrieved; 

a commercial database within which are stored commercials which are transmittable to the 
at least one system user, wherein each of the commercials is associated with one or types of the 
demographic information; 

a processor in electrical connection the network interface, the schedule database and the 
program source, wherein the processor is configured to retrieve the multimedia information selected 
from the one or more schedules, and to transmit the retrieved multimedia information to the system 
user over the connection established by the system user through the network interface; and 

said processor further configured to select one or more commercials associated with the 
entered demographic information and to transmit the selected commercial with the selected 
multimedia information. 

23. The network server of claim 22 wherein the program source comprises at least one 
of: a database containing the multimedia information as data files and an external broadcast source. 

25 



24. The network server of claim 22 wherein the processor is further configured to 
transmit a plurality of multimedia information presentations simultaneously to different 
system users. 

25. The network server of claim 22 wherein the data network is the World Wide Web. 
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EVIDENCE APPENDIX 
None. 



X. RELATED PROCEEDINGS APPENDIX 
None. 



28 



XI. CONCLUSION 

Based upon the foregoing, Appellant respectfully requests the Board to reverse the 
Examiner's § 103(a) rejections of all pending claims and to pass the above-identified patent 
application to issuance. 



Respectfully submitted, 

MARSH FISCHMANN & BREYFOGLE LLP 

By: /ROBERT G. CROUCH/ 

Robert G. Crouch 
Registration No. 50,843 
3151 South Vaughn Way, Suite 4 1 1 
Aurora, Colorado 80014 
Date: April 13. 2007 (720) 562-5506 



29 



APPENDIX A 
A copy of U.S. Patent No. 6,006,265 to Rangan, et al. 
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ABSTRACT 



Streaming digital hypervideo including copious embedded 
hyperlinks is distributed upon a digital communications 
network from a hypervideo server, normally an Internet 
Service Provider, to multitudinous client subscribers/users/ 
viewers (client SUVs). Some or all of the client SUVs 
receive the same hyperlinks at the same place in the stream- 
ing hypervideo. Some small fraction of the client SUVs 
selectively volitionally exercise a fraction of the total 
hyperlinks, causing an access in the background of the 
unfolding hypervideo across the digital communications 
network to yet another server commonly called a "Video On 
Web server", or "VOW server". The VOW sever interprets 
each hyperlink request in consideration of (i) the identity of 
the exercising client SUV and, most commonly, (ii) addi- 
tional data of a demographic, socioeconomic, credit, view- 
ing preference, security and/or past hyperlinking history 
nature. The VOW Server supplies each hyperlink-exercising 
client SUV with a potentially custom hyperlink — normally 
in the form of a network universal resource locator (URL) or 
an index to a file of URLs — while keeping track of com- 
mercially useful data regarding the client SUV response(s). 
Each client SUV uses its own associated received URL to 
retrieve a potentially unique resource. The resource can be 
internal, such as an executable software program, but is 
normally located somewhere on the network and is typically 
in the nature of tailored and/or targeted advertisements, 
messages of personal or local or temporal pertinence and/or 
urgency, and/or the results of contests or lotteries. Hyper- 
video hyperlinks are thus dynamically resolved during 
streaming network communications to support full custom 
hyperlinking by each of multitudinous networked client 
SUVs. 

31 Claims, 11 Drawing Sheets 
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HYPERLINKS RESOLUTION AT AND BY A 
SPECIAL NETWORK SERVER IN ORDER 
TO ENABLE DIVERSE SOPHISTICATED 
HYPERLINKING UPON A DIGITAL 
NETWORK 

RELATION TO RELATED PATENT 
APPLICATIONS 

The present patent application is related to the following 
U.S. patent application: Ser. No. 09/088,513 for the REAL- 
TIME RECEIPT, DECOMPRESSION AND PLAY OF 
COMPRESSED STREAMING VIDEO/HYPERVIDEO, 
WITH (1) DISPLAY OF PAST SCENES, (2) RETRO- 
SPECTIVE HYPERLINKING AND/OR RETROSPEC- 
TIVE RECORDING AS ARE BOTH KEYED TO DIS- 
PLAYED PAST SCENES, AND, WITH SPECIAL 
SERVER SUPPORT, (3) DIVERSE VERSATILE 
RESPONSES TO HYPERLINKS, filed on Jun. 1, 1998, 
which application concerns a client subscriber/user/viewer 
upon the same digital communications network as is the 
special server of this application, and the of the related 
applications is to inventors including certain inventors of the 
present application. 

All applications are assigned to common assignee Tata 
America International Corporation. The contents of the 
related patent applications are incorporated herein by refer- 
ence. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present and related inventions generally concern (i) 
the machine-automated distribution, processing and network 
communication of streaming digital video/hypervideo, par- 
ticularly upon digital networks having network content 
providers (nominally an "Internet Content Provider", or 
"ICP"), network service providers (nominally an "Internet 
Service Provider", or "ISP'), and network client subscribers/ 
users/viewers ("client SUVs"). The present and related 
inventions also generally concern the provision of diverse 
sophisticated responses — including branching, storage, 
playback/replay, subscriber/user-specilic responses, and 
contests — to SUV "click-throughs" on hyperlinks embedded 
within streaming digital hypervideo. 

The present invention in particular concerns software 
processes operating at a special digital communications 
network server called a "Video On Web Server", or "VOW 
Server". This VOW Server does not normally serve stream- 
ing digital video, nor hypervideo (which instead comes from 
video servers that may be associated with any of content 
providers, network service providers, and/or third-party net- 
work sites such as advertisers) upon the network, but rather 
interprets hyperlinks present in streaming digital hypervideo 
when these hyperlinks are selectively exercised by indi- 
vidual client subscribers/users/viewers (SUVs) of the hyper- 
video. The hyperlink interpretation that is the field of the 
present invention is in particular directed to customizing the 
hyperlinked response(s) accorded each and every client 
SUV. As well as being customized to the individual client 
SUV, the responses are very diverse in nature, potentially 
invoking many different network resources at many different 
network locations. 

2. Description of the Prior Art 

2.1. Introduction to the Theory of Hypervideo 

There is no requirement to read the present section 
2.1 — which section is based on the early investigations and 
research into hypervideo of Sawhney, et al., as transpired at 
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MIT (reference cited below) — in order to understand the 
function, and, at a crude level, the purpose(s) of the present 
invention. However, hypervideo is, as of the present time 
(1998) very new, and few people have experienced it. The 

5 present section may accordingly beneficially be read in order 
to gain a "feel" for hypervideo. 

More fundamentally, the present section discusses the 
considerable power of hypervideo, and ends with a discus- 
sion of the empowerment that hypervideo provides to a 

10 user-viewer. The present and related inventions, although 
they can be narrowly thought of as mere systems and 
methods for delivering lowly commercials in the hypervideo 
environment, are really totally consistent with the more 
profound, and the more ennobling, purposes of hypervideo. 

15 Therefore the present section may also beneficially be read 
to understand to what purposes — both good and ill — 
hypervideo may be put, and as background to how the 
present and related inventions serve these purposes. 

In recent years Sawhney, el al., al MIT (reference cited 

20 below) have developed an experimenlal hypermedia proto- 
type called "HyperCafe" as an illustration of a general 
hypervideo system. This program places the user in a virtual 
cafe, composed primarily of digital video clips of actors 
involved in fictional conversations in the cafe; HyperCafe 

25 allows the user to follow different conversations, and offers 
dynamic opportunities of interaction via temporal, spatio- 
temporal and textual links to present alternative narratives. 
Textual elements are also present in the form of explanatory 
text, contradictory subtitles, and intruding narratives. Based 

30 on their work with HyperCafe, Sawhney, et al. have been 
leaders in discussing the necessary components and a frame- 
work for hypervideo structures, along with the underlying 
aesthetic considerations. The following discussion is drawn 
entirely from their work. 

35 "Hypervideo" can be defined as "digital video and 
hypertext, offering to its user and author the richness of 
multiple narratives, even multiple means of structuring 
narrative (or non-narrative), combining digital video with a 
polyvocal, linked text." Hypervideo brings the hypertext 

40 link to digital video. See Sawhney, Nitin, David Balcom, Ian 
Smith "HyperCafe: Narrative and Aesthetic Properties of 
Hypervideo." Proceedings of the Seventh ACM Conference 
on Hypertext. New York: Association of Computing 
Machinery, 1996. 

45 An even earlier approach to hypermedia was proposed by 
George Landow, in which he offered rules for hypermedia 
authors, rules that took into account hypermedia's derivation 
from print media and technologies of writing. Landow 
proposed that hypermedia "authors" learn which aspects of 

50 writing applied to the emerging hypermedium, and which 
traits or characteristics needed redefinition and rethinking. 
He noted: "To communicate effectively, hypermedia authors 
must make use of a range of techniques, suited to their 
medium, that will enable the reader to process the informa- 

55 lion presented by this new technology." See Landow, George 
P. "The Rhetoric of Hypermedia: Some Rules for Authors." 
Journal of Computing in Higher Education, 1 (1989), pp. 
39-64; reprinted in Hypermedia and Literary Studies, ed. by 
Paul Delany and George P. Landow, Cambridge, Massachu- 

60 selts: MIT Press, 1991. 

Hypervideo has its roots in both hypertext and film. As a 
result, hypervideo embodies properties of each field, but 
wholly can be placed in neither, for hypervideo is not strictly 
linear motion picture, nor is it strictly hypertext. This 

65 convergence known as hypervideo comments on each 
discipline, on their similarities, and on their differences. 
Hypervideo is potentially nonlinear, like hypertext, but 
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displays moving images, like film. Hypervideo can signify 
through montage, like film, and can generate multiple 
dictions, like hypertext. Properties of each medium are 
present in hypervideo. These properties take on new forms 
and practices in hypervideo. 

Hypervideo relocates narrative film and video from a 
linear, fixed environment to one of multivocality; narrative 
sequences (video clips followed by other video clips) need 
not subscribe to linearity. Instead of creating a passive 
viewing subject, hypervideo asks its user to be an agent 
actively involved in creation of text through choice and 
interaction. Hypervideo can potentially change viewing sub- 
ject from a passive consumer of the text to an active agent 
who participates in the text, and indeed, is engaged in 
constructing the text. 

Just as hypertext necessitated a re-reading of the act of 
reading and writing, hypervideo asks for a re-viewing of 
narrative film and film making and practices of viewing a 
film. Hypervideo redefines the viewing subject by breaking 
the frame of the passive screen. Hypervideo users are 
participants in the creation of text, as hypertext readers are. 

Research is presently (circa 1997) projected to determine 
just how users of hypervideo systems navigate, interact with, 
and experience hypervideo-texts. Just as J. Yellowlees Dou- 
glas has exhaustively researched hypertext readers and the 
act of hypertext reading, similar projects are expected to be 
undertaken by hypervideo researchers. See Douglas, J. Yel- 
lowlees. "Understanding the Act of Reading: the WOE 
Beginner's Guide to Dissection." Writing on the Edge, 2.2. 
University of California at Davis, Spring 1991, pp. 112-125. 
See also Douglas, J. Yellowlees. "'How Do I Stop This 
Thing?': Closure and Indeterminacy in Interactive Narra- 
tives." Hyper/Text/Theory, ed. by George P. Landow. Bal- 
timore: The Johns Hopkins University Press, 1994. 

Hypervideo is related to film. Hypervideo has the poten- 
tial to reveal important associations present in a film, and the 
constructedness of linear filmic narratives, and to this end, 
would be a beneficial tool for use with film studies education 
and research. Hypervideo can make available, by way of 
link opportunities, the different associations and allusions 
present in a filmic work. These associations are made 
manifest with hypervideo, made available for the student (or 
teacher) to see and explore. Relationships between different 
films can then be tracked, linked, commented on, revealed. 

Hypervideo engages the same idea of "processing" that 
hypertext writing does: in writing hypertext, one makes 
available the process of writing, representing it visually (in 
the form of the web the writer builds), rhetorically (in the 
linking structure of the work, the points of arrival and 
departure present in the text)-and so one makes apparent the 
tensions and lines of force present in the act of writing, and 
the creation or reification of narrative. "Writing" hypervideo 
does the same for image-making-thal is, makes clear the 
notion of constructing images and narrative. In the case of 
hypervideo, "narrative" refers to narrative film making. Just 
as hypertext has within it the potential to reveal the con- 
structedness of linear writing, and to challenge that 
structure, hypervideo does the same for narrative film 
making-while also offering the possibilities for creating rich 
hypervideo texts, or videotexts. 

How does narrative film function in hypervideo? Narra- 
tive film is necessarily re-contextualized as part of a network 
of visual elements, rather than a stand-alone filmic device. 
Because narrative segments can be encountered out of 
sequence and (original) context, even strictly linear video 
clips are given nonlinear properties. 

Sergei Eisenstein pioneered the concept and use of mon- 
tage in film. Hypervideo reveals and foregrounds this use. 
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Eisenstein proposed that a juxtaposition of disparate images 
through editing formed an idea in the viewer's head. It was 
Eisenstein's belief that an idea-image, or thesis, when jux- 
taposed through editing, with another, disparate image, or 

s antithesis, produced a synthesis in the viewing subject's 
mind. In other words, synthesis existed not on film as 
idea-image, but was a literal product of images to form a 
separate image-idea that existing solely for the viewer. 
Eisenstein deliberately opposed himself to continuity 

10 editing, seeking out and exploiting what Hollywood could 
call "discontinuities." He staged, shot, and cut his films for 
the maximum collision from shot to shot, sequence to 
sequence, since he believed that only through being force to 
synthesize such conflicts does the viewer participate in a 

15 dialectical process. Eisenstein sought to make the collisions 
and conflicts not only perceptual but also emotional and 
intellectual." See Bordwell, David and Kristin Thompson. 
Film Art: An Introduction. Fourth Edition. New York: 
McGraw-Hill, Inc., 1993. 

20 Hypervideo potentially reveals this thesis/antithesis 
dialectic, by allowing the user to choose an image-idea (in 
this case, a video clip), and juxtaposing it with another 
image-idea (another video clip). Hypervideo allows the user 
to act on discontinuities and collisions, to engage with 

25 colliding subtexts and threads. 

The user selects a video clip from a black canvas of three 
or four clips. Each clip lies motionless on the canvas. The 
user drags a clip onto another one, and they both start to play. 
Voices emerge and collide, and once-separate image -ideas 

30 now play concurrently, with one image extending the frame 
of the other. The user is left to determine the relationship 
between the two (or three or four) video clips. 

Such video intersections recall Jim Rosenberg's notion of 
simultaneities, or the "literal layering on top of one another 

35 of language elements." See Rosenberg, Jim. "Navigating 
Nowhere/Hypertex Infrawhere." ECHT 94, ACM SIGLINK 
Newsletter. December 1994, pp. 6-19. Instead of language 
elements, video intersections represent the layering of visual 
elements, or more specifically, visual elements in motion. 

40 This is not to say that words, in the case of Rosenberg's 
Intergrams, are not visual elements; on the contrary, they 
are. In fact, their image -ness is conveyed with much more 
clarity (and even urgency) than are non-simultaneous words, 
or words without an apparent visual significance (save the 

45 "transparent" practice of seeing "through" letter-images into 
words into sentences into concepts). Once the word-images 
have to contend with their neighbor-layers for foreground 
screen space, their role in both the practice of signification 
(where meaning is contingent on what neighborly O's and 

50 1's are NOT), and as elements of a user interface (words that 
yield to the touch or click or wave of the mouse) become 
immediate and obvious. Nor is this to say that video clips 
aren't "language elements"; on the contrary, they are. The 
hypervideo clip is caught, as are words and letters, in the act 

55 of signification and relational meaning-making (. . . what 
neighborly O's and f's are not . . . ), mutable to the very 
touch of user, to the layers above and below. 

The hypervideo author can structure these video intersec- 
tions in such a way that only X and Y clips can be seen 

60 together, or X and Z if Y has already been seen (like 
Storyspace's guard fields), and so on, and the author can 
decide if a third video should appear upon the juxtaposition 
of X and Y. For example, Video X is dragged onto Video Y 
and they both start to play. The author can make a choice to 

65 then show video Z as a product, or synthesis, of the 
juxtaposition of Videos X and Y, that reflects or reveals the 
relationship between Videos X and Y. This literal revealing 
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of Eisenstein's synthesis is made possible with hypervideo. 
Of course, no synthesis need be literally revealed; that can 
be left up to the viewer. While the interactions are structured 
by the hypervideo author or authors (as Eisenstein structured 
the placement and editing of thesis and antithesis idea- s 
images), the meaning-making is left up to the hypervideo 
user. His or her choice reveals meaning to him with each 
video intersection; meaning in the system is neither fixed nor 
pre-determined. This empowering principle of hypertext is 
also a property of hypervideo. 10 
2.2. Recent Practical Developments in Hypervideo 

The V-Active HyperVideo Authoring Environment of 
Ephyx Technologies, Ltd. is a hypervideo authoring tool 
reportedly designed to develop interactivity in full-motion 
digital video applications. The V-Active product is based on 15 
a proprietary hypervideo technology that enables (i) auto- 
matic definition of objects, or hotspots, within an applica- 
tion's video stream and (ii) linking of those objects to video, 
sound, and text files, plus Web URLs. 

Using an image processing algorithm, the V-Active' prod- 20 
uct is reported to define a video hotspot once and lo then 
automatically maintain this hotspot across the video 
sequence. The software is reportedly capable of maintaining 
the hotspots even through fast action and low-light video 
sequences. Developers can choose among a dozen hotspot 25 
attributes, including author-defined shapes, overlay colors, 
and cursor-overrun reactions. 

Ephyx calls this authoring strategy hypervideo — full- 
motion digital video with embedded hyperlinks to related 
content through automated means of creating video 30 
"hotspots." In accordance with the general concept of 
hypervideo, these hotspots link moving objects within a 
video sequence to a variety of media, including static 
pictures, text, sounds, URLs, other video sequences, or 
executable software applications. Hotspots are evident to the 35 
user either by changes in the cursor shape or on-screen 
object-specific highlighting. Other features of the V-Active 
product include automated motion tracking, synchronized 
playback of multiple media elements streaming 
simultaneously, and platform independence and support for 40 
numerous digital video formats. 

The Ephyx software reportedly also enables developers to 
create applications in which end-users simply click on 
highlighted objects within a video to link instantly to related 
content via various connections, including selected URLs. 45 
The V-Active product further reportedly permits that hyper- 
linked videos created with V-Active may be integrated into 
a variety of environments; a V-Active Director Xtra inte- 
grates V-Active interactive video elements into Director 
applications, while the V-Active ActiveX Control and 50 
V-Active Netscape Plug-In embed hyperlinked video into 
Web pages. 

With V-Active, authors can enable pointing and clicking 
between digital video hotspots, and they can also define any 
moving objects as gateways to other video sequences or to 55 
activating other applications. Interactive video clips pro- 
duced with V-Active can be integrated into existing envi- 
ronments using a Macromedia Director 5 Xtra and Microsoft 
Active X control. Refer to the web page and product 
literature of Ephyx Technologies, P.O. Box 12503, 9 Maskit 60 
Street, Herzliya 46733, Israel (http://www.ephyx.com as of 
1998). 

SUMMARY OF THE INVENTION 

The present and related inventions contemplate high- 65 
performance hypervideo. In general, the inventions contem- 
plate (i) machine (computer) processes for efficiently mak- 



ing effective — meaning powerful and useful — hypervideo, 
and (ii) machine (computer) processes for providing 
versatile, unique and highly useful responses to the hyper- 
video so made. 

The hypervideo (i) so made, and (ii) so used, goes way 
beyond mere digital television with embedded hyperlinks 
communicated upon a digital network — interesting, useful 
and, in parts, novel as even this concept may be. Instead, the 
present and related inventions contemplate full custom 
hypervideo: each and every one of hundreds and of thou- 
sands of subscriber/user/viewers upon a digital communi- 
cations network is, by and large, (a) receiving copious digital 
hypervideo hyperlinks, with (b) any and all actions ("click- 
throughs") on any hyperlinks being resolved in respect of (i) 
when it happens, (ii) from which client SUV it happens, and 
(iii) even in respect of what is happening at other client 
SUVs. 

Although, to some, it may initially appear impossible that, 
circa 1998, tailored customization and versatility of any 
great magnitude in the delivery of digital information so 
extensive as is hypervideo could be realized in and by 
existing computers communicating across existing broad- 
band digital networks, the present and related inventions are 
quite feasible. Basically, in accordance with the present and 
related inventions, hypervideo management (for benefit of 
client SUVs, individually; as is the subject of the present 
invention) is partially divorced from hypervideo generation 
and delivery (as are the subjects of two related patent 
applications) is yet still further partially divorced from 
hypervideo use (in client SUVs; as is the subject of yet 
another related patent application). Thus the several 
demanding functions for a complete hypervideo system are 
distributed upon the digital communications network. By 
this partitioning of the various functions within a digital 
network hypervideo system, the computer software pro- 
cesses of the present and related inventions — already imple- 
mented and presently running on (i) modern digital network 
servers communicating streaming digital hypervideo across 
cable networks to (ii) cable modems present in Pentium©- 
class personal computers of client SUVs — permit unprec- 
edented flexibility. (Pentium® is a registered trademark of 
Intel, Inc.) 

Basically every single one of thousands of client SUVs 
served by a single (typically neighborhood) network service 
provider (ISP), typically by coaxial cable, is able to select 
for viewing — whenever, in whatsoever sequence and at 
whatsoever pace, interruption(s) and branching as are then 
desired — several scores of different choices of video each of 
which is normally held available over a span of some days, 
and then replaced. In return for permitting thousands of 
client SUVs each to "do their own" thing in (hyper)video 
viewing, the ISP definitively knows what particular (hyper) 
video each (and every) individual client SUV is receiving. 
Furthermore, importantly, and in accordance with the 
present invention, a special network server (which may be 
located at the ISP, or as another server on the network) 
comes to know which responses (if any) each (and every) 
client SUV ever makes to hyperlinks. 

Using the power of this knowledge, certain network 
resources provided/linked to the individual client SUVs — 
notably commercials — are "targeted" on the particular client 
SUV Thus the "price" to the client SUV for high 
performance, flexibility and personal control in his/her 
(hyper)video viewing is that information is surrendered 
about his/her individual habits and preferences — which situ- 
ation is, of course, nonexistent for television broadcast either 
on the airwaves or upon digital communications networks. 
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1. Context of the Present Invention Within Related 
Inventions, and Within a Complete System for Enabling 
Hypervideo on Digital Communications Networks 

A first and a second related invention to the present 
invention respectively concern (i) making and (ii) distribut- 
ing hypervideo. Hypervideo is (i) made from (a) video and 
(b) hyperlinks by software-based editing processes. Such a 
hypervideo editor is taught in the related patent application 
for HYPERVIDEO AUTHORING AND EDITING BY 
DRAGGING AND DROPPING DIVERSE HYPERLINKS 
INTO AUTOMATICALLY-DETECTED SCENE 
HOTSPOTS, WITH SCENES' DURATIONS BEING FUR- 
THER AUTOMATICALLY DETECTED. 

Perhaps more interestingly, these processes may be auto- 
mated or semi-automated, so as to efficiently seamlessly 
insert hyperlinks into video, including in real time while the 
video remains compressed. Hypervideo may thus be both (i) 
made and (ii) distributed in real time, for example in the 
form of a hyperlink-annotated live video newscast. The 
insertion of video and hypervideo clips and hyperlinks in 
streaming digital video/hypervideo is taught within the 
related patent application for REAL-TIME TARGETED 
INSERTION OF VIDEO CLIPS, HYPERVIDEO CLIPS 
AND/OR HYPERLINKS IN COMPRESSED STREAM- 
ING VIDEO, INCLUDING DYNAMICALLY AT MUL- 
TIPLE POINTS BETWEEN CONTENT PROVIDERS 
AND SUBSCRIBERS IN DIGITAL NETWORKS. 

The inserted hyperlinks will ultimately, and indirectly in 
accordance with the present invention, serve to access still 
further, other, digital (hyper)video clips, particularly com- 
mercials. This hyperlink insertion is normally done at any of 
a network content provider, or Internet Content Provider (an 
"1CP"), an Internet Service Provider (an "ISP"), and/or a 
Local Network Affiliate (a "LNA"). The video with inserted 
hyperlinks, ergo hypervideo, is variously received (by 
means ranging from a transported disk to network 
communication) at a network video server, and is ultimately 
served on demand to each client subscriber/user/viewer 
("SUV") upon a digital communications network by this 

Anext, third, related invention concerns the receipt of the 
streaming digital hypervideo upon the network, and the 
display at each of potentially thousands of client subscribers/ 
users/viewers (client SUVs) of the received hypervideo and 
its embedded "hotspots" (which are visual manifestations of 
hyperlinks). Selective volitional exercise of any inserted 
hyperlink(s) — the existence of which hyperlink(s) is (are) 
made visually manifest to the SUV as hotspots on the video 
imagery — by the client SUV is typically by action of the 
SUV to "point and click" with a computer mouse, a so-called 
"click through". 

A click-through on an embedded hyperlink by the client 
SUV sets in motion the present invention, which is a 
software-based process present upon a special network 
server. (This special server may, however, have other roles 
such as being a, or the, network/Internet content provider 
(ICP), video server, or network service provider/internet 
service provider (ISP).) 

The present invention is particularly directed to the cus- 
tom management of streaming digital video/hypervideo for 
each single one of potentially thousands and tens of thou- 
sands of subscribers/users/viewers (SUVs) upon a digital 
network communicating, inter alia, hypervideo. Each and 
every client SUV may receive any of (i) video/hypervideo 
content, (ii) hyperlinks, (iii) services, such as record/storage 
and playback/replay, (iv) controlled access to information 
(such as is commonly used to restrict viewing by children), 



and/or (v) contest results, in accordance with his, her or their 
unique (network) identity. 

In functioning to manage and to condition plural streams 
of digital hypervideo responsively to, at least partially, the 

5 unique dictates (choices) and/or the unique identity of an 
individual SUV, a computer program of the present inven- 
tion operating at the special server (which server may, 
however, also be an ICP, an ISP or a LNA) cooperatively 
interacts with a compatible computer program operating in 

10 the network-connected computer of the SWV. 

The special server is called a "Video On Web Server", or 
"VOW Server". (It is also, alternatively, called a "HOTV™ 
Server", where HOTV™ is a trademark of Tata America 
International Corporation, assignee of the present invention; 

IS although this term will not be used within this specification.) 
At first presentation, the names "Video On Web Server", or 
"VOW Server" may be slightly confusing: this server does 
not particularly, primarily, or uniquely serve (hyper)video on 
the digital network, or web, it enables hypervideo on the 

20 digital network, or web, in a manner to be explained. To say 
again, the VOW Server is not normally a server of streaming 
digital video, or hypervideo, which normally comes from 
video servers that may be associated with any of content 
providers, network service providers, and/or third-party net- 

25 work sites such as advertisers. The VOW Server is given its 
expansive name because, however, it will soon be seen to 
enable the distribution and the progression, and the custom 
distribution and progression, of (hyper)video to, and at, all 
the network client SUVs. 

30 The computer program resident at the client SUV, and 
complimentary to the "VOW Server", is called a "Video On 
Web Video Cassette Recorder", or "Video on Web VCR", or 
just simply "VOW VCR". (Similarly to the "HOTV™ 
Server", this client program is also called a "HOTV™ 

35 Client" where HOTVM is a trademark of Tata America 
International Corporation, assignee of the present invention; 
although this term will not be used within this specification.) 
This VOW VCR of the SUV is described in the companion 
patent disclosure for REAL-TIME RECEIPT, DECOM- 

40 PRESSION AND PLAY OF COMPRESSED STREAMING 
VIDEO/HYPERVIDEO, WITH (1) DISPLAY OF PAST 
SCENES, (2) RETROSPECTIVE HYPERLINKING AND/ 
OR RETROSPECTIVE RECORDING AS ARE BOTH 
KEYED TO DISPLAYED PAST SCENES, AND, WITH 

45 SPECIAL SERVER SUPPORT, (3) DIVERSE VERSATILE 
RESPONSES TO HYPERLINKS. The "SPECIAL 
SERVER" referred to in the title of this related application 
is the subject of the present application. Note that the 
"special server" supports "diverse versatile responses to 

50 hyperlinks". 

In simplistic terms, the related inventions may be con- 
sidered to concern (i) how to make fully group or 
community-customized and time-customized hypervideo, 
normally at an ICP/ISP/LNA, and (ii) how each SUV, or 

55 client, may sense and may exercise hyperlinks within 
streaming digital hypervideo, while the present invention 
concerns (ii) how the SUVs' exercise(s) of hyperlinks are 
accorded, at the special server (which may be the ICP/ISP/ 
LNA), a fully customized interpretation. 

60 Accordingly, the related disclosures and this disclosure 
may beneficially be read together. 
2. Particular Objectives of the Present Invention 

The present invention contemplates dynamic hyperlink 
resolution, meaning that a hyperlink — no matter whether 

65 initially distributed to a small network community or an 
entire nation, no matter whether recent or aged, and no 
matter with what (hyper) video "hot spot" ostensibly 
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associated — is not an invariant, inflexible and unchanging 
link to, at all times and by whomsoever exercised, a link to 
the same network location, nor to the selfsame identical 
network resource, but that, instead, the same hypervideo 
hyperlink, as and when exercised by each separate 5 
subscriber/user/viewer ("SUV") is differently interpreted by 
a special server dependent upon (i) which SUV, exactly, is 
believed to have exercised the hyperlink, (ii) the economic 
and/or accounts and/or credit status of the exercising SUV, 
(iii) the previously-expressed preferences of the SUV, (iv) 10 
the time of day, week, month or year, (v) the proximate 
exercise of the same or of related hyperlinks by other SUVs, 
and (vi) still other factors. After the exercised hyperlink is so 
interpreted by the special server (which occurs in the 
background, and without visibility to the SUV), then the is 
SUV exercising the hyperlink is caused (by this special 
server, and by software processes running at the client SUV) 
to branch to a network location, or to access a network 
resource (which may even be a resource located locally at 
the SUV himself/herself/itself!), in consideration of all the 20 
factors of the exercise. 

The present invention thus contemplates the custom inter- 
pretation and execution of hyperlinks "after the fact" of their 
creation. This is part of the implementation of full custom 
hypervideo by the present and related inventions: each and 25 
every one of hundreds and of thousands of subscriber/user/ 
viewers upon a digital communications network is, by and 
large, (i) receiving common, or at most semi-custom, digital 
hypervideo hyperlinks (in accordance with a related 
invention), while (ii) any and all actions ("click-throughs") 30 
on any hyperlinks are resolved in respect of when it happens, 
from which SUV it happens, and even in respect of what is 
happening at other SUVs (i.e., the present invention). 

Hyperlinks thus interpreted only when, and if, actually 
exercised by a specific SUV are thus susceptible of being 35 
focused, and targeted, on the particular specific SUV exer- 
cising the hyperlink. That is exactly what the present inven- 
tion does: it makes hyperlinking (within streaming digital 
hypervideo) specific to (i) the particular place (the SUV), 
and to (ii) the particular time of the hyperlink exercise, and 40 
specific to (iii) still other factors. 

Hyperlinks thus interpreted are always timely. Even if an 
SUV was to exercise a hyperlink in a hypervideo recorded 
some years previously, hyperlinking that is currently rel- 
evant will, in most cases, still ensue. For example, suppose 45 
an ancient hyperlink that — when all the numbers of the 
hyperlink's URL were interpreted — had really once been 
only a indirect means of accessing a commercial of a local 
Ford automobile dealership was to be, during the playback 
of a recorded hypervideo, clicked after the lapse of some 50 
years. The dealership may have disappeared or have 
changed, and the advertisement originally accessible from 
exercise of the hyperlink may have long since disappeared, 
but it is entirely probable in accordance with the present 
invention that encoding of the more significant bits of the 55 
hyperlink will always indicate that this hyperlink is some- 
how related to the Ford Motor Company. Logically a link to 
a current Ford site, and current a Ford commercial, would be 
served up to the hyperlink-exercising SUV — even if some 
particular long past commercial was no longer extant. 60 

Hyperlinks thus interpreted are rationally ordered and 
responded to in consideration of the interpretation of all 
other hyperlinks. Logically only some limited, desired, 
numbers of hyperlink-exercising SUVs can be, and will be, 
declared "winners" of a contest or a lottery. Logically, no 65 
greater number of hyperlink-exercising SUVs will be con- 
currently sent to particular network site, nor concurrently 



directed to obtain a particular network resource, than the site 
or the resource can support; other SUVs being delayed or 
otherwise routed. 

Hyperlinks thus interpreted are flexible. If some particular 
hyperlink proves popular and often-exercised, then the com- 
mercial or other network resource accessed by the hyperlink 
can be maintained. Any commercial or other network 
resource that could have been accessed through and by a 
hyperlink that is never exercised need not be maintained, or 
maybe relocated to be accessed through some hyperlink that 
is exercised. 

3. Dynamic (Hypervideo) Hyperlink Resolution 

The present and related inventions go beyond the mere 
generation, and the network distribution, of streaming digital 
hypervideo, and custom hypervideo. The present invention, 
in particular, permits that responses to any "click-through 
(s)" made on any hypervideo link(s) by each and every 
separate SUV may be fully customized. Moreover, these 
customized responses may be in consideration not only of 
static or semi-static data such as who the responding client 
SUV is, and what is known about him/her, and what time of 
day and day of the week it is, etc., etc., but responses may 
also be dynamically formulated in consideration of the 
"click-throughs" made on hypervideo links by all the SUVs 
collectively. In other words, the present invention helps to 
empower hypervideo by acting on hypervideo link requests 
in a broad, substantial and versatile manner. 

The manner in which the present invention works as is 
follows. Although hypervideo may potentially be sent from 
the network hypervideo server to as few as just one 
(watching) client SUV, the hypervideo, with its embedded 
hyperlinks, normally goes out to many client SUVs in 
common as a "multicast". The hyperlinks may be inserted by 
the ICP, or by the video server, or by the ISP in consideration 
of the local community or group receiving the hyperlinks 
(within the hypervideo), the time of day, etc. For example, 
hyperlinks that are (i) suitable to the perceived demograph- 
ics of the (digital network hypervideo) audience, and/or (ii) 
localized to link (ultimately, indirectly, as next explained) 
the commercials of a local merchant, may be "served up" to 
some portion of the network audience in common. However, 
the upstream hypervideo providers do not normally find it 
efficient to fully customize thousands of hyperlinks per hour 
going to each of thousands of individual client SUVs when 
only an infinitesimal fraction of the hyperlinks will ever be 
exercised — even though they could so customize each and 
every hyperlink. 

Instead, a single hyperlink at one spot in the hypervideo 
may be, and commonly is, delivered in common to many, or 
to all, client SUVs. Instead of leading directly to the ultimate 
network site, or network resource, that will (ultimately) be 
accessed by the client SUV if he/she "clicks through" on this 
hyperlink, the hyperlink instead points to a particular portal 
of the special server. For example, to use the universal 
resource locator (URL) notation of the world wide web, the 
hyperlink might be to http://www.specialserver.com/car_ 
ford_ad_40. The client SUV does not normally see this 
URL, nor exactly care what it is. The URL may in fact be 
nothing but numbers, and may effectively be indecipherable 
as to exactly what response might be expected to be forth- 
coming from any exercise of the URL. 

As the sample URL suggests, a car advertisement from 
Ford (the fortieth one of such) is to be expected from the 
client exercise of the sample hyperlink. But what 
advertisement, exactly? This is where the special server 
combines the (i) identity of the responding client SUV with 
(ii) pre-existing data bases (that are in part maintained from 
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collected responses) so as to deliver to the responding client 
SUV not, most commonly, the final resource (the 
advertisement) but, instead, most likely, another URL point- 
ing to the advertisement. For example, if the client SUV 
clicking on a Ford motor car hotspot is from a poor 
neighborhood, and/or has shown a proclivity for austerity in 
consumption and/or automotive consumption, then an 
advertisement for a less expensive Ford automobile, and/or 
possibly one extolling economies of vehicular operation, 
might be linked for and to this particular client SUV. 
Conversely, if the client SUV clicking on a Ford motor car 
hotspot is from a rich neighborhood, and/or has shown 
proclivities for conspicuous consumption and/or automotive 
consumption, then an advertisement for a luxury Ford 
automobile, and/or possibly one extolling the prestige of 
Ford ownership, might be linked for this particular client 
SUV. Clearly still more subtle distinctions are possible. This 
is called "targeted advertising", the benefits of which are 
well understood. 

Accordingly, the special server acts to "hand off' the 
client SUV to a target destination/resource. This is com- 
monly done by sending back to the client SUV a very, very 
short and fast message containing a URL, The client SUV 
will then go out on the network to retrieve the resource at 
this URL, wheresoever it may be and howsoever long it may 
last. There is, of course, the possibility that the responding 
client SUV (i) cannot reach the special server, or (ii) is 
exercising an obsolete link portal, such as might occur if the 
client SUV is exercising a hyperlink on hypervideo recorded 
some weeks, months or years previously. There are many 
ways to deal with this situation, starting with the use of quite 
general portals (e.g., the http://www.specialserver.com/car_ 
ford) at the server and continuing with default hyperlinks 
(e.g., http://www.specialserver.com/default or http:// 
www.isp.com/nolink) . 

The software processes of the present invention may be 
present at any "special" service provider receiving, and 
acting upon, hyperlink "click throughs" anywhere within a 
(hypervideo) digital communications system. An advertiser 
pays the special server (and, or course, the ICP/ISP/LNA so 
that the hyperlinks are present in the first place) not just to 
receive "click through" traffic, but, particularly in the case of 
the special server, so as to know more about the persons 
clicking through. This may be for purposes of, for example, 
follow-up mailings or e-mailings. Normally the most "intel- 
ligence" resides within the SUV databases at the special 
server, while the network resource providers (the ICP, ISP, 
and/or LNA) and the advertisers are quite "dumb". An 
advertiser having a network site (a "web site") may, 
however, choose to "play" a different advertisement at the 
same network site depending upon the day, and/or the time 
of day, at which the site is accessed through a hyperlink. 

Accordingly, the special server of the present invention 
acts on any "click-through(s)" made on any hypervideo 
link(s) by any SUV in a network hypervideo system so as to 
first interpret what in particular the SUV wants, and to then, 
so far as is possible and authorized, to either give it to 
him/her or, more commonly, to give directions to him/her as 
to how to get it. 

The SUV may want, and may command by making a 
particular type of click on hyperlink (e.g., with the left 
mouse button), to branch into a new (hyper)video stream. As 
long as the new stream is not forbidden to the particular SUV 
because of content previously restricted (at least at the 
present time of day) by the SUV himself/herself (such as to 
control viewing by children), and/or because the selected 
video stream is pay-per-view and the SUV's account is not 
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in good standing, the SUV will be fed a link to the new video 
stream (possibly uniquely out of all SUVs!). 

Meanwhile, and quite remarkably, the old stream (the 
"mainstream") is also continued, and is still received and 

5 stored (for so long as capacity allows) in the background at 
the subscriber/user. (See the companion patent disclosure.) 

The SUV may alternatively want, and may command by 
making a particular type of click on hyperlink (e.g., with the 
right mouse button) or by clicking a particular on-screen 

10 control button, to commence recording — which may, 
remarkably, be done from a retrospective point in time — or 
to, at a later time, stop recording. The recording will be 
stored locally for so long as capacity allows, which is 
typically not long (streaming digital video making volumi- 

15 nous use of memory), and will then be stored remotely upon 
the network, normally at the supplying ISP. Consider that the 
recording of the video stream that is being fed to any user is 
really transpiring all the time, as it is for all Hie video 
streams, at the ISP/LNA. (Indeed, if not a "live" video 

20 stream, the video stream is normally stored at the ISP/LNA.) 
The SUV "click-through" really serves but to send out to 
the ISP/LNA a first time marker when recording is 
commenced, and a later time marker when recording is 
stopped. The SUV does not see, nor sense, this. When he/she 

25 goes to replay the recorded video then the stored video is 
retrieved, either locally or from the common central store, 
and is replayed to the SUV exactly as if is was a full-custom, 
or fully locally-stored, recording! 

4. The Objectives, and the Capabilities, of the Special Server 
30 of the Present Invention in a Network Hvpervideo System 
The network server of the present invention is a software- 
controlled computer "server" operating in conjunction with 
1) a video (or hypervideo) content server (a Network Con- 
tent Provider, or Internet Content Provider, or simply an 
35 "ICP", and 2) a client (a "Video-on-Web VCR", or simply a 
"VOW VCR") which is described in lot the companion 
patent application. The software-controlled computer 
"server" of the present invention is itself commonly called 
a "Video on Web Server", or simply a "VOW Server". 
40 The objectives of the VOW Server system of the present 
invention are as follows. 

4.1 Multiple Sources of Multiple Hyperlinks all upon the 
Same Hypervideo Feeds 

First, the VOW Server system of the present invention 

45 permits multiple hyperlinks from multiple sources to effec- 
tively coexist simultaneously within the same hypervideo 
feed. In crude terms, it permits multiple separate parties to 
get a "bite" at the SUV. This is because a SUV receives 
streaming hypervideo within which are imbedded hyper- 

50 links arising from multiple feeds from separate sources. The 
originator of the hypervideo stream, or network Content 
Provider, or Internet Content Provider, or "ICP", adds the 
first hyperlinks. More hyperlinks may be added (by use of 
the VOW Server system of the related invention) within the 

55 same hypervideo stream by a regional distributor, and still 
more by a local network service provider (e.g., by an ISP or 
a LNA). If is crassly considered that all hyperlinks are 
simple commercials — which they need not be — then it is 
immediately apparent that, as one way of describing the 

60 situation, hyperlinks to each of national and regional and 
local advertisements will constantly be present in the hyper- 
video received by each SUV. 

4.2 Customized Hypervideo. Both Overt and Covert Via 
Exercised Hyperlinks 

65 Second, the VOW Server system of the present invention 
acts as a tool for the insertion of customized hypervideo 
commercials both overtly and covertly in the hypervideo 
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feed to each particular SUV. It will be understood that each 
SUV is receiving (network digital) video (hypervideo) on 
demand, and need not, and commonly is not, in synchronous 
sequence with any other SUV. 

Moreover, in accordance with what providers at all levels 
want to send to a particular SUV — be the differential deliv- 
ery be based on anything from crude demographics to an 
exacting personal profile of the individual SUV — the par- 
ticular SUV will receive a variously customized regimen of 
both overt and covert commercials. Overt commercials are 
those that appear unless the SUV makes some effort, such as 
"fast-forward" or branch on link, to avoid them. They are 
analogous to commercials on commercial broadcast televi- 
sion. 

The covert commercials are those that are present behind 
the hotspots and associated custom hyperlinks (which need 
not be exercised) that are presented to each SUV Note that 
for either and all types of commercials the SUV may, and 
commonly does, branch on the network (at least 
temporarily) from a video (or hypervideo) stream originat- 
ing at the ISP/LNA to another stream also originating at the 
ISP or the LNA acting as the commercial provider. In other 
words, when a particular SUV is presented a commercial 
from the Ford Motor Company, then he/she may have gotten 
the commercial from any of (i) the ICP, (ii) the ISP or the 
LNA, or (iii) even upon the communications network 
(nominally, the Internet) from some site (some Universal 
resource locator, or URL) at the Ford Motor Company, and 
not from any network content or service provider! Quite 
simply, commercials can, in accordance with the principles 
of network communication, come from almost anywhere. 

The principle challenge is not how to deliver 
commercials, nor, for that matter, hypervideo itself. The 
main challenge is how to deliver commercials intelligently, 
and to good effect, without alienating the SUV from the 
commercials, or, in extreme cases, the medium (the digital 
communications network) of their transmittal. 
4.3 Dynamic Hyperlink Resolution as Supports, Inter Alia. 
Network Lotteries and Coupons Distributions 

Third, the seeded hyperlinks are resolved at run time. Any 
and all of the servers along the distribution of the video 
stream to the SUVs may intentionally insert links that have 
results that are, to the SUVs and to any individual SUV, any 
of unexpected, randomized, and/or chance. These links are 
resolved at run time when a SUV clicks on objects in video 
(including advertisements), and thereby determines the link 
destination to which the SUV's VOW VCR agent will go. 
This process is referred to as "dynamic hyperlink resolu- 
tion". This concept may be used, among other important 
purposes, to implement a "lottery" or "coupon" system in 
commercials in a manner hitherto unseen in either streaming 
video or television media. 

Note that this "dynamic hyperlink resolution" can be 
implemented in many different ways. A unique hyperlink 
may be distributed to one, or to a few, SUV. The entire SUV 
audience may be told to "click on the new Ford" and "if you 
see a red star then please click through because you have 
won a new car". The SUV audience is then further told "but 
if you don't then please click through to see our Fall bargains 
anyway". (To prevent automated, or hacked, interception of 
winning "codes" by SUV-installed software filters, the "red 
star" may be a one-time symbol, or symbol unique to an 
individual SUV, and not publicly known.) The class of 
potential winners has thus been identified before the fact (of 
the distribution of winning "tickets", much like lottery 
scratch-off tickets). 

Alternatively, the class of potential winners may be iden- 
tified after the fact (much like regular lottery tickets, where 
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the whining numbers are pulled after the tickets are sold). 
Many SUVs may get (from time to time, and in time 
rotation) the same hyperlink, where a "caller number 100" 
will win the car. In this case the network site — the special 

5 server — to which all SUVs clicking-through become routed 
keeps track of SUV responses, and identifies the winner. 
4.4 Insertions of (i) Scene Change Points and (ii) Associated 
Text Annotations. Particularly as Exemplifies that Virtually 
Any Type of Information Can be Appended to Streaming 

10 Hypervideo 

Fourth, the VOW Server system of the present invention 
permits that virtually any type of information can be 
appended, or hyperlinked, to streaming hypervideo at the 
last, and concurrent with, or even after, hypervideo (with 

15 contained hyperlink) distribution. 

In accordance with a related invention, (i) pre-determined 
scene change points, and (ii) the associated text annotations 
for those scenes, as supplied within the streaming hyper- 
video. (Text annotations are not hyperlinks, although they 

20 may be associated with hotspots and hyperlinks such as, for 
example, to give an textual explanation of the hotspot and 
associated hyperlink.) These (i) scene change points and (ii) 
associated text annotations are of importance in organizing 
the display of the present and the historical hypervideo, and 

25 hyperlinks, by the client SUV, or, more precisely, the 
"Video-on-Web VCR," software process running at the 
Client SUV. These (i) scene change points and (ii) associated 
text annotations are sometimes predetermined by humans — 
who clearly do not perform this task in real time. This would 

30 commonly be the case if the content provider was delivering, 
for example, a movie. The "scene change points" would be 
related to major transitions in the movie, and all annotations 
could be carefully drafted. 

However, the (i) scene change points and (ii) associated 

35 text annotations may alternatively be determined, and, in 
accordance with the related invention, inserted into stream- 
ing hypervideo, in real time! This would be typical, for 
example, of a live news transmission. The simplest "scene 
change points" are readily detectable by machine process 

40 from changes in the scene images. The (ii) associated text 
annotations may be provided by anyone from a stenographer 
to a voice recognition program to a "canned" schedule of the 
news program, much in the manner of present-day captioned 
television. The (ii) associated text annotations can be omit- 

45 ted without deleterious effect other than the attendant loss of 
the associated information. 

Although the (i) scene change points, and (ii) associated 
text annotations, have a very logical, and elegant, purpose as 
is discussed in a companion patent application, their impor- 

50 tance in the present invention is as an indication of the 
tremendous flexibility of the VOW Server system of the 
invention in inserting just about any nature or any type of 
information whatsoever into streaming hypervideo. Clearly 
it is equally possible to insert in real time any of (i) captions, 

55 (ii) music, (iii) commentary, or (iv) control codes into 
responses made to SUV click-throughs on hyperlinks within 
streaming hypervideo by use of the VOW Server of the 
present invention. 

But, consider this: some selected types of hyperlinks and 

60 hyperlinking may be made mandatory, and need not be 
subject to "point and click" by the Client SUV in order that 
hyperlinking should ensue. This means that the same (i) 
captions, (ii) music, (iii) commentary, or (iv) control codes 
may be, by use of the present invention, effectively inserted 

65 into, or linked so as to effectively become within, streaming 
digital hypervideo after the fact of the multicast of this 
hypervideo. 
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This is exactly how (hyper)steaming video is enabled to 
incorporate functions taken for granted on (modern) televi- 
sion. For example, an uneliminatable unavoidable always- 
exercised hyperlink to a possible, sometimes present, severe 
weather warning (i) message, and/or (ii) a warning tone, 
may be inserted. The steaming hypervideo receiver is then 
(to the extent that it runs through these mandatory 
hyperlinks) always a "weather radio"; it simply gets a null 
message, completely opaque to the SUV, most of the time. 
If a real emergency arises no (hyper)video nor any hyperlink 
needs be suddenly inserted into the hundreds of different 
(hyper)video streams being watched by the thousands of 
SUVs; hyperlinks already leading to previously dormant 
messages may already be present. When the emergency 
arises, the hyperlinked message on some message server 
becomes no longer dormant, and "plays" at the SUV. 

Video (hypervideo) presentations — such as, for example, 
of a state funeral — may be "back dropped" with (iii) com- 
mentary both audio and/or textual, which commentary may 
be viewed and/or heard or else suppressed by SUV prefer- 
Still further for example, a (iv) logic bomb — which for all 
digital technologies is in fact no more than simple pro- 
grammed directives — may be sent to a non-paying SUV. 

Each of these separate scenarios, for separate purposes, is 
worthy of considerable though and analysis. Suffice it to say 
only that there is some "control", and potential control, 
going on over the network and inside the streaming digital 
hypervideo. This quite unlike the world wide web, where 
each client with his or her browser goes when and where lie 
or she will, willy nilly. Instead, there is some degree of 
directivity, and potential latent directivity, "built in" to the 
delivered hypervideo. 

4.5 Security in Networked Distribution of Streaming Hyper- 
video 

Fifth, the VOW Server system of the present invention 
supplies security information to the client, or the "Video- 
on-Web VCR". Such information may include whether or 
not a particular SDV has the authority to record a particular 
clip or not, or whether or not the SUV can jump to a 
particular clip via a hyperlink or not. This is similar to, but 
distinct from, the prior art pay-per-view situation where the 
remainder of a show can't be seen unless paid for. 

As with the dynamic hyperlink resolution, the security 
information may be qualified either, or both, before and after 
the fact. Consider the following example. The "Jones" 
household with children has registered with its network 
service provider to decline notification of any "R"-rated 
pay-per-view offerings. When an advertisement for such an 
offering, or a hyperlink to a preview of such an offering, is 
issued out to SUVs in the SUV base, the "Jones" household 
will not receive either. The "Jones" household will, however, 
receive an advertisement and/or accompanying hyperlink to 
a "G"-rated pay-per-view offering. Alas, the hyperlink leads, 
again by prior-stated preference of the Jones household, not 
to the preview, but rather to a security filter requiring 
entrance of a password. Little "John Jones", not having the 
password, might as well keep on with his (streaming 
hypervideo) lessons. Big "Jack Jones", John's father, has the 
password and enters viewing of the preview. When after 
viewing the preview, however, "Jack Jones" decides to 
immediately partake of the pay-per-view offering, and clicks 
through in an attempt to do so, then the pay-per-view server 
knows from comparing Jack's entrance code — previously 
provided uniquely to Jack's server one time at the earlier 
start of the preview — to the credit list for all codes that Jack 
has not paid the Jones's last bill, and must receive a dunning 
message instead of the desired pay-per-view offering. 



The considerable importance of the present invention in 
the context of security is a follows. A capability for strong 
positive transactional control is clearly inherent in any 
network transaction where each party is certain as to who, 

5 and only who, is at the other end of a communications link. 
At the present time, this control is established by forming a 
point-to-point secure link, typically encrypted, the security 
of which link is valid only so long as the link is maintained. 
(These links are typically presently used in Internet 

lQ commerce.) The problem arises when, in the world of the 
nearly infinite branching possibilities of hyperlinks, a secu- 
rity feature must be offered or enforced at a time later than, 
and possibly very greatly later than, an occurrence upon 
which the security function will be predicated. 

The basic solution to this problem is what cryptologists 

15 refer to as the "one time pad". Party Agives parly B a unique 
number which is good to transmit (or to predicate) infor- 
mation in the future but one time only. Once the unique 
number is used once for information transmission from B to 
A, then it is forever discarded. 

20 In the context of streaming hypervideo, the implementa- 
tion of a one time pad is straightforward. For each and every 
network security event prospectively in the future to be 
presented — and even those events that will never be, in fact, 
broached by every SUV — timely issue to each individual 

25 SUV a unique number (which may, but need not be, be in 
form of a unique URL) for each event. If the "right" SUV in 
the future comes to have the "right" number, then a security 
filter is satisfied, and not otherwise. 

The challenge is clearly to give every single SUV a 

30 stream, which may be a copious stream, of unique numbers. 
Generation and management of the numbers is no big 
problem; distributing them to the SUVs is. This the present 
invention makes possible. 

4.6 Monitoring, Accumulation, and Use of User-Subscriber 
js Information as Represented by User-Subscriber Click- 
Thro ugh s 

Sixth, the VOW Server system of the present invention 
permits the gathering, and the accumulation, of valuable 
information regarding each SUV entity, regarding SUVs by 
40 groups that are regional or otherwise, and by all SUVs taken 
together. This is accomplished by recording SUV elick- 
throughs and using this recorded information to develop 
both personal, group and collective SUV statistics. 

These and other aspects and attributes of the present 
45 invention will become increasingly clear upon reference to 
the following drawings and accompanying specification. 
BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 is a diagrammatic view of the origin and transfer 
50 of digital video/hypervideo data upon a digital network to 
multiple subscribers/users/viewers (SUVs), including 
through, by way of example, an Internet Service Provider 
(ISP) or a Local Network Affiliate (LNA) acting as the 
essential special server, or VOW Server, where hyperlinks 
5S within hypervideo are resolved in accordance with the 
present invention. 

FIG. 2 is a schematic block diagram of the major software 
components of the VOW Server (as communicates across 
the network with the Client SUVs) in the preferred embodi- 
60 ment of the present invention. 

FIG. 3a is a block diagram of the production of 
hypervideo, containing both (i) hotspots and (ii) associated 
hyperlinks, at an authoring station in the content provider 
(shown in FIG. 1) the preferred embodiment system of the 
65 present invention. 

FIGS. 3b through 3d are block diagrams of the control and 
data exchange between the VOW Server/Internet Service 
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Provider and the Client SUV in the preferred embodiment of large, the video/hypervideo he or she wants when he or she 

the present invention. wants it — much in the manner of "surfing" the sites of the 

FIG. 4 is a pictorial representation of a screen shot such world wide web — but also that some sites or sites upon the 

as might be seen on a monitor of a Client SUV in the system network — normally but not exclusively, nor invariably, the 

of the present invention, which system was previously seen 5 Internet Service Provider (ISP) — come to know a great deal 

in FIGS. 1 and 2. more about what, and when, the Client SUV is viewing than 

FIG. 5 is a schematic view of the architecture of a portion heretofore. This knowledge is not gained by any sort of 

of the preferred embodiment of a system in accordance with insidious monitoring of the Client SUVs. Instead, it should 

the present invention (as was previously diagrammatically be n*oguzed that the Client SUVs from time to time 

shown in FIG. 1), the portion including 1) a video server, 2) 10 ldentlf y, and un , k > t0 the (hyper)video that each wishes to 

a network "video on web" control server (the "VOW Vlew ' 11 * slm P ] y necessary to set U P a network structure 

Server") which is commonly, and by way of example, whe , re these Cllent SUV choices can be assimilated, 

located at a network service provider (the "ISP"), and 3) catalogued, and, optionally optimally, acted upon. This the 

multiple "video on web VCRs" ("VOW VCRs") of Client P resent mention accomplishes; permitting (i) the ready 

subscribers/users/viewers ("SUVs"). 15 gathering ol Client SUV "interest" data as is expressed by 

, . ... . "click-throughs" on hvpervideo hotspols having associated 

ctS u 1 % a d^ammatic V1 ew illustrating that a C bent h ^ and the use of the cumulative data so 

SUV whose VOW VCR is playing .hypervideo may click on hered (0 a( ^ ^ and/Qr from , ime , 0 u 

a hotspot to branch to a network page display, or "web predicate ^ issuance of> and/or the branchmg (linking) in 

page ' 20 respect of, further hyperlinks later in time. There is thus a 

FIG. 7 is a diagrammatic view illustrating that a Client trade: the Client SUV, as an inevitable consequence of 

SUV whose VOW VCR is playing hypervideo may click on "surrendering" interest information, permits that this infor- 

a hotspot to alternatively branch to another video, or hyper- ma ti 0 n should be reasonably, and intelligently, interpreted 

video, and acted upon so as to shape, if not the future viewing 

FIG. 8 is a diagrammatic view illustrating that a Client 25 experience for the Client SUV (i.e., for purposes of 

SUV whose VOW VCR is playing hypervideo may click on propaganda, or pandering to Client bias) the future com- 

a hotspot to alternatively branch to, by way of example mercial offerings to the client (i.e., salesmanship). The result 

among many different network resources two of which have is generally favorable to both Client SUV and network 

already been diagrammatically illustrated in FIGS. 6 and 7, advertiser: the Client SUV is ultimately absolved of watch- 

a slide show. 30 ing "commercial" in which he/she has no interest, or is even 

FIG. 9 is a top-level software flow chart of the VOW hostile, and is instead presented, at least in part, with the 

Server of the present invention, by which software a Client focused and targeted information, albeit often commercial 

SUV hyperlink "click-through" request is dynamically information, that busy lives require, 

resolved. O ne related invention particularly concerns how, 

FIGS. 10 and 11 are second-level software flow charts of 35 typically, both (i) video and hypervideo clips, typically 

the sequence of processing the Client SUV hyperlink "click- containing advertising, and (n) hotspols and associated 

through" request in the VOW Server of the present inven- hyperlinks, which hyperlinks commonly lead to advertising, 

jj orl may be inserted, if necessary on-the-fly, into streaming, 

compressed (normally MPEG compressed) video. Note that, 

DESCRIPTION OF THE PREFERRED 40 in the vernacular, both (i) commercials and (ii) hyperlinks to 

EMBODIMENT commercial may be inserted, and commonly (at least for 

1. Context and Environment of the Present Invention sponsored programming), both are. The insertion, and the 

It being assumed that the SUMMARY OF THE INVEN- management, of hyperlinks is separate from, and is different 

TION section of this specification has been read, this first than, and should not be confused with, the fact that video 

paragraph of this section focuses on the larger systems 45 and hypervideo clips may also be inserted as (typically 

environment in which the special server, and the dynamic periodically scheduled) commercials within the streaming 

hyperlinking processes, of the present invention, are opera- hypervideo. In accordance with the related invention, both 

tive. The present and related inventions contemplate com- insertions may be done on-the-fly and while the hypervideo 

puter systems and software tools that can automatically: 1) is streaming, and compressed (normally MPEG 

analyze an incoming stream of video for scene changes in 50 compressed). 

real-time; 2) cut/copy/paste from/to the video, including so Hyperlinks (such as are commonly associated with 

as to insert hotspots over inserted hyperlinks, thus making commercials) are, of course, distinguished from embedded 

hypervideo; 3) delivering the hypervideo upon a digital (video and hypervideo) commercials for, inter alia, the fact 

communications from a hypervideo server to clients, where- that an embedded commercial will normally inevitably 

upon the clients may "click on" hotspots in the moving 55 unfold unless action is taken by the Client SUV — possibly 

hypervideo to hyperlink; 4) resolving the clients' hyperlink- by clicking on a hyperlink! — while hyperlinked commer- 

ing at a special network server so that 5) the clients may cials will not normally unfold (i.e., be seen) unless specific 

ultimately branch as desired between network resources Client SUV action is taken to click on a hyperlink, 

including hypervideo, 6) recording as desired any sequence Of course, in the networked real-time world things need 

thereof so as to build as desired a mosaic or album of 60 not, and are not, always what they seem to be. The classic 

interesting scenes. The present invention — which more par- case of this is the "local" commercial, corresponding to the 

ticularly concerns functions 4) and 5) — is thus but one existing "station breaks" on network television where are 

aspect of a more extended system, and concept. inserted commercial messages from the local affiliates. 

The overall system could be called, and considered to be, Things get complicated when it is remembered that the 

"full performance hypervideo". Such "full performance" not 65 video feed to the Client SUVs; — insofar as there is one, or 

only means that a Client subscriber/user/viewer (SUV) upon ten, or a hundred such — may have come to the ISP by 

the digital hypervideo distribution network retrieves, by and satellite overnight, and the ISP is really both "station" and 
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"network". I should be understood that, in accordance with multicast, then at the same time) until a scene break near the 

the present and related inventions, commercials can be nine minute elapsed mark. Only lx of network bandwidth is 

"inserted" into network-distributed digital hypervideo, and required. Some Client SUVs then receive 30 second com- 

video, in many places, and at many times— for even the mercial A, and then pick up with the video. Other Client 

same video content! It is not so much a challenge of how to s SUVs continue in the program video/hypervideo until near 

get the commercials into the network distributions, but how the ten minute mark, and then receive 30 second commercial 

to get them in so that digital networks do not become the B ' then pi ckin g U P again with the video/hypervideo. Finally, 

"vast wasteland" ascribed to television. stl11 other Client SUVs continue in the program video/ 

It must in particular be considered that even the "regular" hypervideo until near the eleven minute mark, and then 

scheduled, commercials, can be accessed by hyperlinks, and - recelve 30 Second commercial C. At the conclusion ~* 
hyperlinking! These "regular" commercials would thus be 



commercial C all Client SUVs are back "in sync" with a 
, . . ,. , , , single multicast video/hypervideo. The bandwidth required 

considered to be accessed by hyperlinks which, when , , ' ■ , , • • . , , 

. . ... . / ,v . , , .. ' _ , „ rose to 3x from approximately nme minutes to eleven 

arrived at within a streaming hypervideo, have a default 



minutes, thirty seconds, but was only lx for other periods. 



mode which will cause hyperlinking unless the client does bandwic]th is conserved, 

something to the contrary. The client customization ability 15 of course , i n accordance with the present ii 

of the present invention is thus useful in both (i) the "force "insertion" is not of clips— as was postulated to be the case 

feeding" the client customized commercials, as well as (ii) with the ICP and possibly several other places upon the 

the customizing of any information (commercial or network— but rather of hyperlinks. The inserted hyperlinks 

otherwise) that the client may volitionally seek by clicking point, of course, to the special server. This special server can 

on a hyperlink. 20 be the ISP itself but, for purposes of alleviating congestion, 

In its ability to manage hypervideo hyperlinks so that it may also be another, separate, server upon the digital 

hyperlinking is customized, the present invention is of use to communications network. 

TV, cable and internet service providers (ISPs) who provide Wheresoever physically located, the special server — and 

and/or who insert into streaming video (and hypervideo) the commercially valuable information that accumulates at 

advertisements, and/or hyperlinks to advertisements. 25 this server regarding the ISP's clients — is normally con- 

The best way of thinking about the present and related trolled by the ISP. However, this special server can alterna- 

inventions is to completely abandon the idea that there is but tively be controlled by something like an advertising agency, 

one information source, and multiple parallel information and the ISP is simply paid a flat rate for its services as a 

sinks — as in broadcast television — and to instead realize that common carrier, or, at most some fee based on how many 

upon a digital communications network information flow 30 and how pliable are its Client SUVs as can be both (i) 

control may be separated from information content, and that periodically "fed" commercials, and, wondrously, (ii) occa- 

all sorts of information resources are "coming and going" to sionally be induced to volitionally access a commercial and 

and from everywhere, and not necessarily concurrently, nor even (iii) buy in response to a commercial, 

in linear time sequence, between all servers and all clients — Accordingly, and in accordance with the present 

much as the Internet functions today. 35 invention, hyperlinks that are eventually resolved to link to 

Network content providers, or Internet Content Providers, (typically local, typically focused) commercials are inserted 

and/or ISP's may, in particular, insert "hard", linear, video by the ISP, and are resolved by the special server at the 

clip commercials in video/hypervideo of their origination — running time of the hypervideo tendered each Client SUV. 

although even this may not be a good idea if the program Note that the special server does not, within a reasonable 

content is to be later "re -shown" (a better term for a network 40 window of some days or weeks, care exactly when this 

may be "reordered outside of anticipated time-of-viewing transpires, and exactly when the hyperlink must be, and 

parameters"). finally is, resolved. 

Network Service Providers, or Content Service Providers, The commercials ultimately resolved at the special server, 

and/or ISPs may, in particular, control the immediate video and then accessed (from anywhere upon the entire network) 

servers from which the network Client SUVs directly obtain 45 by the Client SUV may be (i) static "web pages", (ii) regular 

video/hypervideo — although certainly not all the same video so as to create a relatively non-invasive commercial, 

video/hypervideo, nor invariably synchronously, Indeed, or (iii) hypervideos which, although leaving the commer- 

some client SUVs are typically delivered multicast video/ cials non-invasive, makes the commercials interactive and 

hypervideo, while others may be completely asynchronous. potentially exciting for the user. Namely, the user can click 

The video server might be considered to hold and store, for 50 in the hypervideo commercial to initiate a web transaction or 

example, 48 hours of programming for 16 channels, deliv- to make a purchase. 

ering any and all on demand of an individual client. The ISP From such feedback as may be gained (typically, but not 

may well desire to "insert" local commercials automatically exclusively, at the special server) by user-viewer(s) "click 

at scene transitions as video broadcasts flash by (from either throughs" on inserted hypervideo commercials, subsequent 

live camera feed or video servers), seamlessly streaming out 55 on-the-fly commercial(s) insertion(s) may to be tuned to 

the video/hypervideo with its "inserted" advertisements to local demographic conditions and user profiles, or, 

the client subscribers/users/viewers of the ISP. preferably, even to an individual user-viewer. 

In accordance with the present and related inventions, in 2. The Mechanization of Custom Hyperlinks, and Custom 

order to (i) maximized the network economies of Responses to Subscribers/Users/Viewers Click-Throughs on 

multicasting, while concurrently (ii) delivering custom 60 Hyperlinks 

commercials, commercials may be delivered to the various The present invention contemplates an interaction 

Client SUVs otherwise watching the same video/hypervideo between, and a customization of, (i) the resolution(s) of 

at slightly different times. Suppose, as an extreme example hyperlinks inserted into digital video feeds, and (ii) a sub- 

for purposes of illustration, the network bandwidth is 3x and scriber's recent activity in pursuing hyperlinks embedded in 

it requires lx bandwidth to deliver a video/hypervideo 65 hypervideo. 

content, and lx to deliver a commercial. All Client SUVs In simplest terms, a particular subscriber may have vol- 

commonly receive the same multicast video/hypervideo (if untarily volitionally "clicked through" a video hyperlink (it 
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does not matter whether the hyperlink appears in a program of the stream to be inserted, and a minimum number of video 
or in a commercial) so as to follow, ultimately and indirectly units after which this insertion can take place, 
(in accordance with the present invention) a hyperlink to, by Both the primary programming (from the Internet Content 
way of example, an automotive manufacturer. It may thus be Server that provides the MPEG stream) and the secondary 
logically imputed that the subscriber is, at least momentarily, 5 programming (from the client SUV's Internet Service 
interested in cars, or in a particular car. The automotive Provider) can, and typically do, offer the Client SUV a 
manufacturer whose site was visited would logically desire choice of multiple programming channels. The Client SUV 
to re-visit the subscriber with commercials. For that matter, can select a channel for ensuing playback from, and within, 
other automotive manufacturers, worried that an interested either the primary programming of the secondary program- 
subscriber might be sold an automobile by the competition, 10 ming. In this regard the Client SUV's control is not much 
would also like to immediately get their advertisements to different than television, where a channel can be changed 
the attention of the subscriber. This process simply amounts during a show or during a commercial, 
to "striking while the iron is hot". Note that the Client SUV-selected "channel", or MPEG 

In accordance with the present invention, a party on the stream containing programming, and be another "channel" 
network, normally the special server (which may be, but is 15 or MPEG stream, or the same Internet Content Server that 
not normally, the network communications service provided the first MPEG stream. This is very common. The 
provider), "keeps track" of the hyperlink "click throughs" of SUV is offered, or enticed, to go from a more general to a 
the subscriber. This much alone is not very profound. more specific channel, or to go from one providing enter- 
However, being able to do something the monitored "click tainment and/or education (so as to attract the Client SUV in 
throughs" is. 20 the first place) to one providing such commercial feed as the 

In accordance with the present invention, (hyper)links to Client SUV has, by his channel selection, indicated that 

ultimate (i) video clips, and/or (ii) hypervideo clips, and/or he/she is willing to view. However, the successive main 

(iii) even more hyperlinks, will immediately, and likely "channels" selected for playback at the Client SUV end need 

nearly incessantly, be seamlessly fed back to a client not be of the same Internet Content Server. In other words, 

subscriber/viewer/user once, and, importantly, yet again if 25 more that one "network" may sometimes be received on, and 

(by hyperlinking) the client SUV permits. This concept is from, a single Internet Content Server. Why should this be 

important. The special server of the present invention is not so? It is because if the SUV's Internet Service Provider does 

only a wise (and a patient, and a tireless, and an ever not provide him/her with the "channels" that he/she wants, 

vigilant) "salesman", it is an incredibly persistent "sales- then the Client SUV will likely soon have a new Internet 

man". A client SUV will tell it that he/she is interested in 30 Service Provider. This various MPEG streams as comprise 

something just once and will thereafter not likely lack to be the "channels" are always available either locally or as 

furnished information about it again and again. specified by a URL pointing to a Content Server. 

In the extreme, a client SUV may click but once on, for Accordingly, under processes of the present invention, the 

example, but one auto advertisement in the morning and will Internet Service Provider can feed the Client SUV-selected 

thereafter be lucky if he or she sees anything but endless 35 MPEG stream to the Client SUV for playback. The Internet 

auto and auto dealer advertisements dynamically hyper- Service Provider can access, and can initialize for insertion, 

linked into received streaming video programming all the all secondary streams specified in the Insertion Schedule, 

day long. This process amounts to "focused advertising". The Internet Service Provider can seamlessly insert second- 

3. A Server of DiQital Video Clips, Particularly Advertise- ary streams within the main programming stream in the 

ments 40 order, and at intervals, specified in the Insertion Schedule, 

A server of digital video clips, particularly feeding all such streams to Client SUV for playback. The 

advertisements, can access MPEG streams, available either Internet Service Provider can receive requests from a Client 

(i) locally or (ii) by a Universal Resource Locator (URL) SUV to hyperlink to related videos, which are available 

pointing to a server of clips (an Internet Content Provider of either locally or are specified as a URL. The Internet Service 

sorts). The server at which the clip (the advertisement) 45 Provider can access hyperlink video streams, initializing 

(optionally) resides may, or may not be, the same Internet these streams and feeding them to the Client SUV for 

Content Provider that provided the MPEG stream, or the playback. 

same video/hypervideo server that distributed the stream. On completion of a hyperlink video stream, Internet 

Normally the server of advertising clips is separate from Service Provider can automatically and seamlessly switch lo 

both. It may be, and commonly is, associated with the 50 the earlier playback stream, and can continue sending the 

advertiser (or his agent, the advertising agency). new stream from the hyperlink point. The Internet Service 

Normally, the Internet Content Server that provides the Provider can accept successive requests to hyperlink, thus 

MPEG stream also provides, as part of all of the "price" of forming a hierarchy of video streams. On completion of a 

receiving the stream, commercials, including embedded video, the Internet Service Provider can switch and return to 

hypertext and hypervideo links, that are embedded within 55 playback of the video at the earlier, higher level, 

the video/hypervideo stream in a manner unavoidable by the Finally, the Internet Service Provider can reset and ini- 

Client SUV. This Internet Content Server that provides the tialize all component modules on receiving a close request 

MPEG stream still further specifies, and embeds within the from the user-viewer. 

MPEG stream, an insertion schedule for insertion of sec- These and other performance characteristics of the system 

oudary programming within main, user-selected program- 60 and methods of the present invention will become increas- 

ming. The ISP, and/or the video server, may use this inser- ingly clear with the explanation commencing in the follow- 

tion schedule. Any secondary programming — typically in ing section 4 of this specification, 

the form of MPEG streams as the user-viewers are typically 4. The Client Subscriber/User/Viewer 

but poorly responsive to static displays — is again available In accordance with the present invention, the Client 

either locally or remotely as specified by a URL. The 65 subscriber/user/viewer (SUV), or simply Client, is offered a 

insertion schedule typically consists of entries for each choice of multiple programming channels. One channel can 

insertion instance. Each entry specifies the access path name be, and is, selected for playback. The Client SUV thus 
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conveys back to the Internet Service Provider of the Local 
Network Affiliate (that is also the Advertisement Server) the 
primary programming channel selected by the Client SUV 
for viewing. Immediately the ISP/LNA can tailer the adver- 
tisements later provided to (i) who the SUV is (or at least 
appears to be) and (ii) what the Client SUV has currently 
chosen to watch. 

The Client SUV synchronizes with the ISP/LNA (or 
Advertisement Server) for reception of the user-selected 
primary programming channel. 

The Client SUV plays back all programming received 
from the video server an MPEG stream. Additionally, any 
and all advertisements and messages from wheresoever 
upon the network received are inserted by the Client SUV 
into the primary programming channel as received, and are 
also seamlessly played back. 

The computer system of the Client SUV — called a Video 
on Web VCR, or VOW VCR— can detect video scene 
changes in real-time; as video is being fetched and played 
back all scene transitions can be flagged automatically, and 
boundary frames for a scene noted. 

The computer system of the Client SUV can generate a 
representative frame (also known as a keyframe) for a scene 
as delimited by its start and its end frames. 

The computer system of the Client SUV can cache in 
temporary storage a portion of video being fetched, and can 
subsequently playback this video from cache buffers. 

The computer system of the Client SUV can start record- 
ing digital video from the current play position, as a valid 
MPEG stream; and can stop recording when desired. 

The computer system of the Client SUV can start record- 
ing digital video, as a valid MPEG stream, from the start of 
any scene cached in temporary storage and represented by a 
keyframe. Recording will continue, saving all video frames 
in cache as well as any new video frames being stored in 
cache, until stopped by Client SUV action. 

The computer system of the Client SUV can receive and 
playback hybrid streams — primary programming inter- 
spersed with advertisements — that contain hypervideo infor- 
mation. 

The computer system of the Client SUV can decode 
hypervideo information in the hybrid stream, and the 
(human) Client SUV can mark pre-authored objects of 
interest in playback video. 

The computer system of the Client SUV provides visual 
cues to indicate an object of interest in a video as "hot" and 
thus selectable. 

The computer system of the Client SUV can take a 
predefined action when an object of interest has been 
selected by the (human) Client SUV, typically by act of the 
(human) Client SUV to simply click on the object. Atypical 
predefined action would be the playback of a different video, 
or the playback of a different segment from the same video 
or a connection to an Internet web site using its Universal 
Resource Locator (URL), or, as is most pertinent to the 
present invention, a link to a particular, addressable, portal 
of the special server. 

If accessed, the special sever will typically return to the 
computer system of the accessing Client SUV a video/ 
hypervideo to be played, or, more commonly, a URL point- 
ing to a video-hypervideo to be requested and obtained 
across the network, and played. Thus the predefined action 
of clicking on a hotspot will ultimately cause the playback 
of a different video/hypervideo. If the special server directly 
issues the "playback" video/hypervideo, then this "play- 
back" video/hypervideo may be accessible to the special 
server either locally, or through a Universal Resource Loca- 
tor (URL) or an Internet Content Server. 
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There is the possibility of (i) no action on a Client SUV 
click-through to the special server. There may be no 
connection, or no video/hypervideo nor any further link 
available at the connection, or the hyperlink may simply 

S intentionally be null. 

There is the possibility of (i) delay at the special server in 
response to a Client SUV click-through. The special server, 
and/or the network resources that the hyperlink would be 
resolved to access, or to point to, may be busy. Although 

10 Client SUVs are not expected to like greatly delayed 
responses to clicking on holspots, it is contemplated that a 
response can, if necessary, still be issued after some tens of 
seconds delay. The Client SUV simply continues in the past 
video-hypervideo stream in the interim. 

15 The computer system of the Client SUV can receive from 
video/hypervideo server, and can play back, a new video that 
was selected though resolution of a hyperlink within the 
original, hybrid, programming stream. 

The computer system of the Client SUV can playback a 

20 nested succession of videos; each video appears as a hyper- 
link within the earlier, higher level video. Upon completion 
of a video, the computer system of the Client SUV can 
seamlessly continue to playback the higher level video. 
On action, the (human) Client SUV can close the con- 

25 nection with the video/hypervideo server and can thus end 
ongoing reception of the hybrid programming stream. 

These and other performance characteristics of the system 
and methods of the present invention will become increas- 
ingly clear with the explanation commencing in the next 

30 following section 5 of this specification. 
5. System Description 

FIG. 1 is a schematic block diagram of a digital hyper- 
video communication system including the special dynamic 
hyperlink-resolving server, called a Video on Web Server, or 

35 VOW Server 1, in accordance with the present invention. As 
such, FIG. 1 diagrams the total content delivery environment 
in which the VOW Server 1 operates. 

Live content 2 is produced by network content providers/ 
producers 3, and is delivered onto the digital network 4 by 

40 the Internet Service Provider, or "ISP", 5. The content 2 is 
delivered by the ISP 5 onto what may be considered a high 
speed communications "cloud" in the form of the network 4, 
and this content 2 is consumed by client subscribers/users/ 
viewers, or "SUVs", 7, most of whom are typically home 

45 SUVs. The ISP 5 in turn receives this content 2 from content 
providers/producers 3, either live or on stored media. The 
ISP 5 broadcasts this content 2 as live content or else makes 
it available in stored format on the video server 9. The VOW 
server 1 inserts local, rich, interactive commercial content 

50 using the dynamic hyperlink resolution and dynamic hyper- 
linking method of the present invention. 

During delivery of content 2 onto the network by the ISP 
5, the delivered hypervideo is stored upon the video server 
9 and delivered on demand to the SUVs 7. The delivery may 

55 be in any part multicast (meaning to more than one SUV 7 
at the same time). The delivery is by definition multicast if 
the hypervideo content is from a live video feed. Hotspots 
and associated hypervideo links, or hyperlinks, are always 
first delivered in the streaming hypervideo from the video 

60 server 9. 

The hotspots and associated hyperlinks, which are typi- 
cally links to advertisements or advertising-related promo- 
tions (directly, or indirectly in accordance with the present 
invention the explanation of which is ensuing) may be 
65 inserted either into stored, or into live, video content 2. Of 
course, if inserted into live video then the hotspots and 
associated hyperlinks have to be so inserted in real time. A 
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companion patent application for REAL-TIME TAR- 
GETED INSERTION OF VIDEO CLIPS, HYPERVIDEO 
CLIPS AND/OR HYPERLINKS IN COMPRESSED 
STREAMING VIDEO, INCLUDING DYNAMICALLY AT 
MULTIPLE POINTS BETWEEN CONTENT PROVID- 
ERS AND SUBSCRIBERS IN DIGITAL NETWORKS 
teaches how this is done. The hot links and associated 
hyperlinks may be inserted into hypervideo that goes to as 
few as one single SUV 7, or into hypervideo that is multicast 
to many SUVs 7 at the same time. In other words, any 
individual Client SUV may rarely be receiving hyperlinks 
that are custom (if not also hotspots that are also custom, 
which is rarer still.) Normally, however, in accordance with 
the present invention many Client SUVs, especially those 
linked by geography or demographics or other affinity 
grouping, will be receiving at least some of the same (i) 
hotspots and (ii) associated hyperlinks. Note that these 
Client SUVs need not receive these same (i) hotspots and (ii) 
associated hyperlinks at the same time. Moreover, and in 
accordance with the invention presently being explained, an 
initial receipt of the same (i) hotspots and (ii) associated 
hyperlinks at each of several Client SUVs does not neces- 
sarily mean that, should each "click through" on a hotspot/ 
hyperlink, that each will ultimately access the same network 
resource. 

The connection of the ISP 5, and also the SUVs 7, to the 
high speed network 4, or, typically, the internet, can be 
through any of (i) a cable modem network, (ii) a satellite 
network, and/or a (iii) ADSL (a telephone network). 

The SUVs 7 are necessarily connected to the network, 
typically the internet and more typically the world wide web, 
through a high-speed link — normally, a cable modem — in 
order to support video/hypervideo. The SUVs 7 each inde- 
pendently view and interact with the hypervideo (and other 
video and downloaded content) through a software -based 
functionality called, for purposes of continuity with the 
previous acronym of "VCR" (i.e., a Video Cassette 
Recorder), a "Video On Web Video Cassette Recorder" 
(although no cassette likely exists), or simply a "VOW 
VCR". The function of such a VOW VCR is taught in a 
companion patent application. Basically it behaves like a 
VCR to play and record video with the added function that 
it can respond to click-throughs on hotspots to interpret and 
respond to associated hyperlinks — normally by going out 
onto the network 4 to a designated URL, and most normally 
to (some portal of) the VOW server 1. 

FIG. 2 shows the flow of events from a software- 
component-point-of-view of the architecture. The receipt of 
Client SUV activity triggers the flow. This activity is typi- 
cally a Client SUV click through but also can be a timed 
event on the Client SUV side, or an event associated with the 
playback of video by the Client SUV. The server receives the 
necessary information such as the Client SUV identification, 
current stream, current position in the playback and event 
type and invokes the appropriate sub-program. The VOW 
Server checks if the appropriate sub-program is loaded and, 
if required, loads the sub-program and passes the informa- 
tion received from the client. The sub-program in turn passes 
the information to the appropriate COM object which per- 
forms the core processing by looking up the database and 
also, if necessary, updating it. 

A block diagram of the production of hypervideo — 
containing both (i) hotspots and (ii) associated hyperlinks — 
at an authoring station in the content provider (shown in 
FIG. 1) is shown in FIG. 3a. This first step involves content 
preparation. A network content provider 2 (shown in FIG. 1) 
operates software at an Authoring Station, such as the 
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authoring system of the related patent application, to modify 
a video stream, the MPEG stream 21, to produce and 
authored MPEG stream auth.mpeg 22. The authored stream 
auth.mpeg 22 contains both (i) hotspots and (ii) associated 

5 hyperlinks. The (ii) associated hyperlinks are of two types: 
a 1) first, or static, type and a 2) second, or dynamic, type. 

FIG. 3b through FIG. 3d illustrate the basic mechanism of 
the dynamic hyperlink resolution, and dynamic 
hyperlinking, process of the present invention. 

10 Referring to FIG. 3b, a second step is content delivery. 
The client SUVs 7 stream in the video auth.mpg 22. If the 
link is of type A, client directly goes to the specified URL. 
If the hyperlink is of the first, or static, type 1), then the client 
SUV 7 goes directly to the URL specified by the hyperlink. 

15 If the hyperlink is of the second, or dynamic, type 2), then 
the client SUV 7 also goes directly to the URL specified by 
the hyperlink, but this URL is commonly (a portal of) the 
VOW Server 1. 

Referring to FIG. 3c, the third step is dynamic Hyperlink 

20 resolution. The VOW server 1 resolves the link and sends a 
URL back to the Client SUV 7. It also logs the request. 

Referring to FIG. 3d, the fourth step is when the Client 
SUV 7 fetches the video/web page/slide show using the 
resolved hyperlink. The Client SUV typically fetches this 

25 video or other URL resource from the video server 9, or 
from yet another site on the network 4. 

During all this process, and the viewing of hypervideo, 
the hypervideo is preferably presented at the VOW VCR of 
each SUV 7 substantially as is shown (for a first, primary, 

30 screen out of several potential such screens) in FIG. 4. The 
manner of realizing this screen, and the associated 
functionality, is taught within the companion patent appli- 
cation. For the moment, however, it needs only be under- 
stood that the "video-on-web" VCR, or "VOW VCR", acts 

35 as a web-based playback client through which a SUV 7 can 
select channels, just as the SUV might with a normal TV, so 
as to play back hypervideos or just plain videos. In so doing 
the VOW VCR presents the usual VCR-like controls 71 for 
video play back including fast-forward, pause, rewind and 

40 fast-reverse. The Client SUV 7 uses a simple cursor (not 
visible in FIG. 4) to control the playing of stored videos, 
whereas for live videos clicking on an simple play-and- 
pause control suffices. 

When playing hypervideos the VOW VCR displays the 

45 main video in one screen, as at screen 72. Hotspots 
present — and hotspots are neither always nor invariably 
present — are displayed as is exaggerated, for ease of recog- 
nition in the drawing, at hotspot 73. A text annotation (not 
shown in FIG. 4) preferably appears about the object when 

50 the SUV 7 does a mouse-over on the object. These annota- 
tions can beneficially serve to impart additional, 
supplemental, information about the scene and/or the objects 
in it and/or the hotspot, such as, for example, the identity of 
a particular person in a depicted group of persons. More 

55 commonly, however, the annotation is, or includes, or indi- 
rectly links, a Universal Resource Locator, or URL. If the 
SUV 7 clicks on the hotspot 73 that is associated with a URL 
directed to the VOW sever — and most are — then the video- 
on-web VCR (the "VOW VCR") will jump to the VOW 

60 Server 1 (shown in FIG. 1). 

Third, the SUV 7 can click on a record button, and can 
then record the video starting at the current frame locally on 
his hard disk or other media provided that security privileges 
allow him or her to do so. 

65 In so performing the VOW VCR display thumbnail 
images 74 of scenes which have been defined and delineated 
at the video server 9. See the companion patent application. 
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In the case of "canned" video, these scene changes may well 
have been manually detected, and the scene change bound- 
ary markers long since inserted by an editor sitting at a 
console so as to annotate the video not in real time. In the 
case of "live" video as is typical of, inter alia, news 
broadcasts, the scene change boundaries are automatically 
detected at the video server 9, and the associated hyperlinks 
(if any, and which may be sparse in number) inserted much 
in the contemporaneous manner of a court reporter, or of a 
translator. The inserted hyperlinks may be less numerous, 
less well focused, less wide-ranging, and/or less versatile in 
a live video feed. For example, consider a newscast, and 
particularly the newscast sports segment. A(network) broad- 
cast "station" employee at a computer station has readily to 
hand certain hyperlinks to baseball, football, basketball and 
hockey — if only to the league web sites where the team 
scores are posted. As the sports commentary and/or sports 
scores unfold in the live videocast, minor link insertions by 
this employee serve to "hyperlink annotate" this portion of 
the news. 

At any time about twenty-one most recent such thumb- 
nail images 74, representing twenty most recent scenes will 
displayed. When a new scene is detected it enters the lowest 
corner while the oldest scene is discarded in a first-in, 
first-out (FIFO) fashion. The video corresponding to these 
twenty scenes is also buffered in FIFO fashion on local 
storage. The SUV can click on any of the scenes to start 
recording from that scene. The implication of this is that the 
SUV can record video which has gone by; such as a sports 
action shot or a talk-show dialogue. 

Returning to FIG. 1, the premises of the ISP 5 typically 
contain both (i) one or more video server 9 and (ii) the VOW 
Server 1. Either server can, of course, be physically located 
elsewhere on the network 4. 

Aschematic block diagram of the architecture of a portion 
of the preferred embodiment of a system in accordance with 
the present invention (as was previously diagrammatically 
shown in FIG. 1) is shown in FIG. 5. This portion includes 
(i) the network content provider 2, (ii) the network "video on 
web" control server, or VOW Server 1 which is commonly 
physically located at the ISP 5, and (iii) the "video on web 
VCRs", or "VOW VCRs" of the client SUVs 7, and (iv) the 
network 4. The video stream 91 originates at the video server 
9; the control stream 11 at the VOW Server 1. Both streams 
91, 11 are synchronized, and are received at the VOW VCR 
of a client SUV 7. More particularly the video stream 91 is 
received at the player module 71 of the VOW VCR of a 
client SUV 7 while the control stream 11 is received at the 
control module 71 of the VOW VCR of a client SUV 7. Both 
player module 71 and control module 11 will be understood 
to be software functions. 

Adiagrammatic view illustrating that a Client SUV whose 
VOW VCR is playing hypervideo may click on a hotspot to 
branch to a network page display, or "web page", is illus- 
trated in FIG. 6. 

Likewise, a diagrammatic view illustrating that a Client 
SUV whose VOW VCR is playing hypervideo may click on 
a hotspot to alternatively branch to another video, or 
hypervideo, is illustrated in FIG. 7. 

Finally, a diagrammatic view illustrating that a Client 
SUV whose VOW VCR is playing hypervideo may click on 
a hotspot to alternatively branch to — by way of example 
among many different network resources two of which have 
already been diagrammatically illustrated in FIGS. 6 and 
7 — a slide show is illustrated in FIG. 8. 

A top-level software flow chart of the VOW Server of the 
present invention, by winch software a Client SUV hyper- 
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link "click-through" request is dynamically resolved, is 
shown in FIG. 9. 

Second-level software flow charts of the sequence of 
processing the Client SUV hyperlink "click-through" 
5 request in the VOW Server of the present invention are 
shown, respectively for the processes " A" and "B" identified 
in the top-level flow chart of FIG. 9, respectively in FIGS. 
10 and 11. 

FIG. 9 shows the overall flow in the main branch of 

to processing. The information from the client is passed on to 
the user progression tracker module which is responsible for 
keeping track of user navigation in hypervideo click- 
throughs and playback status of the user. The progression 
tracker "follows" the user when he navigates through hyper- 

15 video and takes decisions about which links have to be 
supplied next to the user by calling various processing 
modules. It is mostly an entity which depends on time and 
determines if the user is currently watching a commercial, if 
so, for how long, whether the user has paused the video and 

20 if so for what duration, and so on. There are two main special 
actions that the progression tracker can take apart from the 
main function pertaining to advertisement servicing. They 
are: a decision to award a prize or coupon to the user or a 
security decision (or branch, both of which are described in 

25 subsequent paragraphs). The main branch then continues to 
retrieve the next set of commercials and their associated 
links (including a prize winning coupon link if told to do so 
by the right branch). The main branch checks if any scene 
annotations need to be conveyed to the user, then checks for 

30 text information to be rendered and then dispatches all this 
control information (including the list of commercials) to the 
user. 

FIG. 10, or the branch "A" processing occurring in the 
main loop of FIG. 9, shows how the hotspot linking is used 

35 to control security and access to videos. In this case, the 
access is of a 'blocking' type — in the sense the client does 
not proceed until it has an answer from the VOW server or 
the user cancels the access. This feature is mainly used for 
controlled access to videos and for commercial purposes — 

40 including e-eommerce transactions and implementing pay- 
per-view schemes. In controlled access scenarios it is mainly 
used to restrict child access to restricted adult material. The 
branch "A" is entered when a security or e-commerce type 
of click is received. The server proceeds to retrieve the 

45 security information initiates a dialogue with the client. If 
validation returns an affirmative answer, the server proceeds 
to give the links to restricted videos along with access keys. 
A similar situation occurs if the access is to a pay per view 
video. If the click is on a e-commerce transaction, the 

50 necessary steps to complete that transaction are completed. 
FIG. 11, or the branch "B" processing occurring in the 
main loop of FIG. 9, outlines the decision to award a user a 
coupon or prize when he/she clicks on a hotspot in the 
commercial. Essentially, this module keeps a count of the 

55 number of times the user accesses the particular commercial. 
If the count is greater than a certain value it qualifies the user 
for a selection (which might be a random or may employ any 
other scheme awards that user a prize or coupon. The count 
is also recorded in the database to give the advertiser 

60 statistics on the number of user accesses to his commercial. 
This mechanism will also be used to award or inform or 
take some special action when the user clicks on a non- 
commercial hypervideo. If the flag has already been set i.e 
in the left branch of the figure, the win is recorded and an 

65 e-mail or other suitable is employed to make the user aware 
that he has won a coupon or prize. In the right branch of the 
figure which illustrates the process when the access flag has 
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not yet been set. What happens in this branch has been 
summarized in the preceding paragraph. 

Thus FIG. 1 has shown a block schematic of the video 
server, the VOW server, the client and the network on which 
these components are connected. FIG. 5 has illustrated the 
flow of data on the same network 'pipe' from video server 
to the playback module of the client and the control stream 
flowing to the control module of the client. Both these 
streams are drawn or pulled by the respective modules on the 
client. 

The steps starting from the preparation of the authored 
MPEG stream to actual playback of dynamic hyperlinks 
have been described. The first step is where objects in video 
are tracked and marked as hotspots and then associated with 
hyperlinks which can be either static or dynamic. However, 
the focus of this disclosure is the concept of dynamic 
hyperlinks and their use for interactive commercials. When 
the client plays back the stream, it identifies dynamic links 
in the stream, co-ordinates with its control module which 
would have fetched the required links (at playback time) and 
plays back the appropriate streams from the video server. 

This dynamic form of linking, meaning that the link is 
decided at playback time, is the theme of the present 
invention. This concept can be used in several different 
ways, specifically detailed in various parts of this disclosure. 
The principle focus is the usage of the concept of dynamic 
hyperlink resolution for (i) timely (i.e., non-stale) delivery 
of (ii) Client SUV-specific interactive commercials, using 
the VOW sever as the vehicle for delivery. 

The scheme of the present invention opens up new 
opportunities for businesses to attract new markets in a 
highly customized fashion, through interactive discount 
offerings, coupons and prize schemes. In addition, it helps 
the advertiser to develop statistics on everything from (i) 
click-throughs of all Client SUVs to particular hyperlinks, to 
(ii) the click-throughs of some particular Client SUV to 
particular hyperlinks, to (iii) the ensuing conduct, potentially 
including on-line purchases and submissions and expres- 
sions of interest, of a particular Client SUV is following a 
particular hyperlink. This is in marked contrast to conven- 
tional broadcast television where there is no interactivity 
with the viewer and/or the viewer's video playback, espe- 
cially including commercials. 
6. Recapitulation of the Invention 

This present specification has described hyperlink reso- 
lution at and by a special network server in order to enable 
diverse sophisticated hyperlinking upon a digital network 
streaming digital hypervideo from a network hypervideo 
server to network clients. The special server operates in 
conjunction with (i) a network video server and (ii) a special 
client called a VOW VCR (which VOW VCR is described 
in a separate patent application). 

The objectives of the present invention, and of the special 
server, are as follows. It acts as a tool to insert customized 
hypervideo, normally commercials, in the hypervideo 
streams that are displayed at individual network Client 
subscriber/users/viewers (Client SUVs). It serves to resolve 
hyperlinks at run time, i.e., to process user clicks on objects 
in hypervideo (including, but not limited to, advertisements) 
so as to determine the link to which the Client SUV will go 
to, or a network resource which the Client SUV will access. 
This process is referred to as 'dynamic hyperlink resolu- 
tion'. 

This concept of dynamic hyperlink resolution may be 
used to implement, for example, a lottery, a contest, or a 
coupon distribution. It permits of interactive commercials 
hitherto unseen in streaming digital video or in television 
media. 
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The dynamic hyperlink resolution may be used to supply 
security information to, and to enforce security restrictions 
on, the VOW VCR of the Client SUV; such as whether the 
Client SUV has the authority to record a particular clip or 

5 not, or whether he/she can jump to a particular clip on a 
hyperlink or not. This is similar to a pay-per-view situation 
where a presentation cannot be seen unless paid for. 

Finally, the dynamic hyperlink resolution serves to record 
Client SUV click-throughs, and to use this information o 

10 develop statistics on Client SUVs both collectively and, 
importantly, individually. 

The overall architecture of the system was seen in FIG. 1. 
The control stream was generated by the special server, 
called a VOW Server, that qualified and added value to the 

IS video stream generated by the video server. Both streams 
were drawn by each Client SUV, the control stream being 
synchronized with the video stream. The video stream could 
either be generated live — such as by an encoder plus a 
camera system — or could be delivered from secondary 

20 storage — such as a hard disk. In general, the video stream 
contained static information such as the tracked information 
of objects in a hypervideo stream while the generated 
control stream contained dynamic information such as the 
hyperlinks. 

25 The block diagram of the VOW Server was seen in FIG. 
6. As stated earlier, the hyperlinks are dynamically resolved 
in this software function based on which Client SUV is 
clicking on what hyperlink, and the time of the clicking. 
The process of dynamic hyperlinking was seen to be as 

30 follows: The Client SUV clicks on a "hot spot" object in the 
hypervideo, say an "object 1". This action is conveyed back 
to the VOW Server by the client software, the VOW VCR. 

The VOW Server (a software process) sends the Client 
SUV time and action information to its resolution compo- 

35 nent. The resolution component uses the data and retrieves 
an appropriate link to an advertisement, a pointer (link) to a 
network resource, or a link to a response. The response could 
be, for example, an announcement of a contest of a lottery 
result: "you've just won a trip to Hawaii", or "you've won 

40 a free dinner for two at the Greek restaurant". A link to an 
appropriate video, hypervideo or network resource is thus 
conveyed back to the Client SUV — which the Client SUV 
sees and uses to decide his or her future course of action. 
The control generation module of the VOW Server is 

45 responsible for taking in the various SUV actions and 
generating the control stream based on various data it 
retrieves from the various sub modules, all as was shown in 
the flow charts. 

Notably, there must have been, and there is, a necessary 

50 preparation of hyperlinks before they are available — even in 
common — to be exercised at the Client SUVs. In particular, 
a scene change module functions as taught within a related 
patent application to recognized (in real time!) the scene 
change boundaries of streaming digital video. The videos 

55 stored on the server are indexed in terms of scenes, with a 
text annotation added to each of these scenes. The VOW 
Server stores a list for each of these MPEG streams. Each 
item in the list consists of two fields: 1) one field is the frame 
number of the scene change point being authored and 2) the 

60 other has the annotation (the text string) corresponding to it. 
As the VOW VCR software process at the Client SUV 
proceeds through the video, it will receive, as part of the 
stream from the video server, the scene change frames and 
their corresponding text annotations. On the client side the 

65 client player (the VOW VCR) displays a thumb nail image 
of a characteristic (first) scene frame, and further displays 
the text annotation when the user does a mouse-over on the 
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thumb nail image. A timer module was responsible for 
timing the insertion of the commercials. 

It is thus possible to understand how the hyperlinks come 
to exist in the first place. Returning now to the functions 
more directly performed by the VOW Server of the present 
invention, this VOW Server runs )as a software process) a 
user data module and advertisement component stored the 
Client SUV profile and information such as age, sex and 
interests. This profile and information was used by the 
advertisement component to select an appropriate commer- 
cial for the Client SUV The user data module and adver- 
tisement component also kept track of the commercials 
clicked by the Client SUV so that overall statistics can be 
extracted out of the advertisement component as regards the 
Client SUV behavior for the commercials. The advertise- 
ment component was thus responsible for retrieval of the 
appropriate ad or other response to a particular Client SUV, 
making its decisions based on the previous data for that 
Client SUV and also global information. Third party com- 
ponents for this particular advertisement component, if 
suitable, may also be substituted for this function. For 
example, Client SUV preferences might be recorded and 
interpreted based on heuristic, or on fuzzy logic, filters. 

In addition, the control stream generation module was 
able to generate security information for the video stream 
which controlled whether the video could be recorded or not 
at the client. 

In accordance with the preceding explanation, variations 
and adaptations of the system and methods of the present 
invention for real-time targeted insertion of video and hyper- 
video clips and hyperlinks in compressed streaming video 
(including dynamically at multiple points between content 
providers and subscribers in digital networks) will suggest 
themselves to a practitioner of the digital communications 
arts and sciences. 

In accordance with these and other possible variations and 
adaptations of the present invention, the scope of the inven- 
tion should be determined in accordance with the following 
claims, only, and not solely in accordance with that embodi- 
ment within which the invention has been taught. 

What is claimed is: 

1. A method of resolving hyperlinks present in hypervideo 
distributed upon a digital communications network, the 
method comprising: 

distributing from a first, hypervideo, network server upon 
a digital network to each of a multiplicity of network 
client subscribers/users/viewers digital hypervideo 
containing hyperlinks that link when exercised to a 
second, hyperlink-resolving, network server; 
selectively exercising at the network client subscribers/ 
users/viewers the hyperlinks so as to cause communi- 
cation linkage upon the network to the second, 
hyperlink-resolving, network server; 
resolving at the second, hyperlink-resolving, network 
server all received, selectively-exercised, hyperlinks in 
consideration of the individual network identities of the 
hyperlink-exercising client subscribers/users/viewers 
and, consequent to this resolving, communicating back 
across the digital network to the hyperlink-exercising 
and communicating client subscribers/users/viewers 
linkage information that is not identical for all, but that 
is instead different for at least two of these hyperlink- 
exercising and communicating client subscribers/users/ 
viewers; and 

receiving at the hyperlink-exercising and communicating 
client subscribers/users/viewers linkage information 
from the second, hyperlink-resolving, network server, 
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and acting upon this linkage information to access 
resources upon the network; 
wherein the resources accessed by at least two of the 
hyperlink-exercising and communicating client 
5 subscribers/users/viewers are different nonetheless to 
the fact that the hyperlinks within the hypervideo 
originally distributed to both were the same. 

2. The method of resolving hyperlinks according to claim 

1 

]0 wherein the interpreting at the second server is so as to 
communicate back across the network information in 
the nature of a network universal resource locator to the 
hyperlink-exercising client subscribers/users/viewers. 

3. The method of resolving hyperlinks according to claim 

.1 

wherein, consequent to the receipt of the information at 
the hyperlink-exercising and communicating client 
subscribers/users/viewers, the resource is retrieved 
upon the network. 

4. The method of resolving hyperlinks according to claim 

20 1 

wherein, consequent to the receipt of the information at 
the hyperlink-exercising and communicating client 
subscribers/users/viewers, the resource is retrieved 
locally, within the client subscribers/users/viewers. 
5 5. A method of resolving hyperlinks present in hypervideo 
distributed upon a digital communications network, the 
method comprising: 

communicating streaming digital hypervideo containing 
, 0 hyperlinks upon a digital network from a first, 
hypervideo, server to each of a multiplicity of network 
client subscribers/users/viewers where at least two cli- 
ent subscribers/users/viewers receive the same hyper- 
link; 

35 selectively exercising at at least two of the network client 
subscribers/users/viewers the same hyperlink so as to 
cause these exercising client subscribers/users/viewers 
to communicate upon the digital network to, in accor- 
dance that the exercised hyperlinks are the same, a 

40 same port of another, second, network server; 

receiving at the port of the second network server noti- 
fication of the exercised hyperlink from each of the at 
least two client subscribers/users/viewers so exercising 
the same hyperlink; 

45 interpreting at the second server all received exercised 
hyperlinks in consideration of the individual network 
identities, known to the second server, of the hyperlink- 
exercising client subscribers/users/viewers and, conse- 
quent to this interpreting, commuuicating back across 

50 the digital network to the hyperlink-exercising and 
communicating client subscribers/users/viewers infor- 
mation that is not identical for all, but that is instead 
different for at least two, of the hyperlink-exercising 
and communicating client subscribers/users/viewers as 

55 did exercise the same hyperlink; and 

receiving at the hyperlink-exercising and communicating 
client subscribers/users/viewers the information that is 
different for at least two of these hyperlink-exercising 
and communicating client subscribers/users/viewers as 

60 did originally exercise the same hyperlink, and, con- 
sequent to the receipt of this information, retrieving a 
resource in accordance therewith, the different infor- 
mation leading to different resources so that at least two 
of the hyperlink-exercising and communicating client 

65 subscribers/users/viewers that originally exercised the 
same hyperlink do not retrieve the same resource but, 
instead retrieve different resources; 
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wherein at least some hyperlink-exercising client 
subscribers/users/viewers, nonetheless to originally 
exercising the same hyperlink, ultimately retrieve dif- 
ferent resources. 

6. The method of resolving hyperlinks according to claim 

5 

wherein the interpreting at the second server the received 
exercised hyperlinks is further in consideration of addi- 
tional data individually associated with each of the 
hyperlink-exercising client subscribers/users/viewers, 
the identities of which hyperlink-exercising client 
subscribers/users/viewers are known. 

7. The method of resolving hyperlinks according to claim 

6 

wherein the interpreting is further in consideration of 
additional data of the nature of demographic data. 

8. The method of resolving hyperlinks according to claim 

6 

wherein the interpreting is further in consideration of 
additional data of the nature of socioeconomic data. 

9. The method of resolving hyperlinks according to claim 

6 

wherein the interpreting is further in consideration of 
additional data of the nature of credit data. 

10. The method of resolving hyperlinks according to 
claim 6 

wherein the interpreting is further in consideration of 
additional data of the nature of hypervideo-viewing 
preference data previously expressed by the individual 
client subscribers/users/viewers. 

11. The method of resolving hyperlinks according to 
claim 6 

wherein the interpreting is further in consideration of 
additional data of the nature of past hyperlinks exer- 
cised by the individual client subscribers/users/ 

12. The method of resolving hyperlinks according to 
claim 11 further comprising after the interpreting: 

updating at the second server a database of information 
concerning past hyperlinks exercised by the individual 
client subscribers/users/viewers in consideration of the 
hyperlink just exercised, and just interpreted. 

13. A digital communications network distributing hyper- 
video with embedded hyperlinks comprising: 

a digital communications network; 

a First, hypervideo, network server distributing upon the 
network to each of a multiplicity of network client 
subscribers/users/viewers digital hypervideo contain- 
ing hyperlinks that link when exercised to a second, 
hyperlink-resolving, network server; 

a multiplicity of network client subscribers/users/viewers 
upon the network receiving thereupon the hypervideo 
from the first, hypervideo, network server, and selec- 
tively exercising the hyperlinks so as to cause commu- 
nication hyperlinking upon the network to the second, 
hyperlink-resolving, network server; 

a second, hyperlink-resolving, network server resolving 
all received, selectively-exercised, hyperlinks in con- 
sideration of the individual network identities of the 
hyperlink-exercising client subscribers/users/viewers 
and, consequent to this resolving, communicating back 
across the digital network to the hyperlink-exercising 
and communicating client subscribers/users/viewers 
linkage information that is not identical for all, but that 
is instead different for at least two of these hyperlink- 
exercising and communicating client subscribers/users/ 
viewers; and 
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wherein the hyperlink-exercising and communicating cli- 
ent subscribers/users/viewers, upon receiving the link- 
age information from the second, hyperlink-resolving, 
network server, do act upon this linkage information to 
5 access resources upon the network; 

wherein at least two of the hyperlink-exercising and 
communicating client subscribers/users/viewers do 
access different resources upon the network nonethe- 
less to the fact that the hyperlinks within the hyper- 
jo video originally distributed to both were the same. 

14. A computerized process performed at a digital com- 
munications network server in response to receipt of notice 
from a particular client subscriber/user/viewer out of many 
subscribers/users/viewers upon the network to the effect that 

15 the particular client subscriber/user/viewer has volitionally 
selected a hyperlink, the process comprising: 

comparing (i) a unique identity of the particular client 
subscriber/user/viewer who has volitionally selected 
the hyperlink with (ii) a pre-existing database of infor- 
20 mation regarding, inter alia, the particular client 
subscriber/user/viewer; and 
choosing and providing a response to the particular client 
subscriber/user/viewer in accordance with the informa- 
tion stored within the pre-existing database of infor- 
25 mation; 

wherein the process is called "dynamic hyperlink resolu- 
tion": because the response to each subscriber/user/ 
viewer who has selected the same hyperlink is not the 
same for all subscribers/users/viewers, but is dependent 
30 upon the individual one subscriber/user/viewer. 

15. The process according to claim 14 

wherein the choosing and providing is of a response in the 
form of universal resource locator. 

16. The process according to claim 15 

33 wherein the chosen and provided response in the form of 
universal resource locator is directed to an advertise- 
ment targeted to the particular client subscriber/user/ 
viewer. 

17. The process according to claim 15 

40 wherein the chosen and provided response in the form of 
universal resource locator is directed to a coupon 
targeted to the particular client subscriber/user/viewer. 

18. The process according to claim 15 

wherein the choosing and providing is of a response in the 
form of a control signal and accompanying information 
to the client subscriber/user/viewer. 

19. The process according to claim 18 

wherein the chosen and provided response in the form of 
SQ a control signal and accompanying information causes 
branching by the particular client subscriber/user/ 

20. The process according to claim 18 

wherein the chosen and provided response in the form of 
S5 a control signal and accompanying information causes 
a display by the particular client subscriber/user/ 
viewer. 

21. The process according to claim 14 further comprising: 
running a contest of skill among the collective notices of 

6Q all subscribers/users/viewers who do timely volition- 
ally select a particular hyperlink; 
wherein the choosing and providing is of a response in the 
form of a win/lose notification of the contest. 

22. The process according to claim 14 further comprising: 
65 running a lottery of chance among the collective notices 

of all subscribers/users/viewers who do timely volition- 
ally select a particular hyperlink; 
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wherein the choosing and providing is of a response in the 
form of a win/lose notification of the lottery. 

23. The process according to claim 14 

wherein the choosing and providing is of a response in the 
form of a dunning notice targeted to the particular one ; 
subscriber/user/viewer who has not paid his or her bill 
from the network service provider. 

24. The process according to claim 14 

wherein the choosing and providing is of a response in the 
form of a pay-per-view video presentation. 1 

25. The process according to claim 14 further comprising: 
keeping track of the notice from the particular subscriber/ 

user/viewer, and other notices from the same 
subscriber/user/viewer, as accumulated information 1 
revealing the preferences and the activities of the 
p arti cula r su bsc ribe r/use r/ vie we r. 

26. The process according to claim 25 further comprising: 
providing hyperlinks in the first instance to the particular 

subscriber/user/viewer in consideration of previously 2 
accumulated information regarding the preferences and 
the activities of the particular subscriber/user/viewer. 

27. In a digital communications network where hyper- 
video containing hyperlinks is communicated from a digital 
hypervideo server to a client subscriber/user/viewer, a 2 
method of resolving a exercise of a particular hyperlink by 

a particular client subscriber/user/viewer out of many such 
subscribers/users/viewers upon the network, the method 
comprising: 

communicating the exercise of the particular hyperlink by 3 
the particular client subscriber/user/viewer over the 
network to a control server where is stored (i) all 
hyperlinks and (ii) information in respect of all 
subscrib ers/use rs/vie wers; 

providing across the digital communications network to - 
the particular client subscriber/user/viewer a universal 
resource locator in accordance with (i) the exercised 
hyperlink, and (ii) the stored information; 

using at the client subscriber/user/viewer the universal 
resource locator received across the digital communi- 4 
cations network to access a network resource; 

wherein the process is called "dynamic hyperlink resolu- 
tion": because the universal resource locator provided 
each subscriber/user/viewer who has selected the same £ 
hyperlink is not the same, but is instead dependent upon 
the stored information. 

28. The method according to claim 27 

wherein the provided universal resource locator is to an 
advertisement in respect of the individual client 
subscriber/user/viewer exercising the hyperlink. 



29. A computerized security process performed at a net- 
work service provider providing upon a communications 
network hypervideo to each of a multiplicity of subscribers/ 
users/viewers upon the network, the process comprising: 

receiving upon a digital communications network com- 
municating hypervideo notice from a particular client 
subscriber/user/viewer out of many subscribers/users/ 
viewers of hypervideo upon the network to the effect 
that the particular client subscriber/user/viewer has 
volitionally selected a hyperlink; 

comparing (i) a unique identity of the particular 
subscriber/user/viewer to whom the hypervideo has 
been supplied with (ii) a pre-existing database of infor- 
mation regarding, inter alia, the preferences of each 
individual subscriber/user/viewer; and 

choosing and providing a particular hyperlink to the 
particular subscriber/user/viewer in accordance with 
the information that was stored in the database regard- 
ing that particular subscriber/user/viewer; 

wherein no subscriber/user/viewer will receive hyperlinks 
offensive to or inconsistent with pre-existing informa- 
tion regarding that subscriber/user/viewer, and, instead, 
each subscriber/user/viewer will receive only hyper- 
links that are consonant with and in respect of the 
pre-existing information regarding that subscriber/user/ 

30. A computerized security process according to claim 

29 

wherein the comparing is to a pre-existing database of 
information regarding, inter alia, the status of accounts 
of each individual subscriber/user/viewer; 

wherein hyperlinks to added cost services are omitted 
from hypervideo network communicated to 
subscribers/users/viewers whose accounts are in 
arrears. 

31. A computerized security process according to claim 

29 

wherein the comparing is to a pre-existing database of 
information regarding, inter alia, the acceptability of 
information of certain types to each individual 
subscriber/user/viewer; 

wherein hyperlinks lo information of certain types are 
omitted from hypervideo network communicated to 
subscribers/users/viewers who do not find such types of 
information acceptable. 
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[57] ABSTRACT 

Different commercial messages are broadcast to differ- 
ent demographically targeted audiences in a cable tele- 
vision system or the like. A first television channel con- 
tains television programs and periodic commercial mes- 
sages. A second television channel contains alternate 
commercial messages. Demographic characteristics of a 
viewer are identified, and commercial messages are 
selectively provided from the first or second channel, 
depending upon the viewer's demographic characteris- 
tics. Demographic data can be input by a viewer via a 
remote control, downloaded to a subscriber's converter 
from a remote headend, or programmed into the con- 
verter at installation. Prioritization of the demographic 
characteristics of a plurality of television viewers 
watching a program together enables commercials to be 
targeted to the viewer having highest priority. Statisti- 
cal data can be maintained concerning the number and 
identity of subscribers viewing specific commercials. 
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nate commercial messages. The selection means provide 
METHOD AND APPARATUS FOR PROVIDING a commercial message from the first or second channel 
DEMOGRAFHICALLY TARGETED TELEVISION depending on the demographic characteristics of a 
COMMERCIALS viewer. Such characteristics might include, for exam- 
5 pie, whether the viewer is male or female, and whether 
BACKGROUND OF THE INVENTION the v i ewe r is an adult or a child. 
The present invention relates to cable television sys- Means are provided for determining when a commer- 
tems and apparatus, and more particularly to the provi- cial message break is about to occur, and the selection 
sion of different commercial messages to different de- means are responsive thereto for providing an appropri- 
mographically targeted cable television audiences. Al- 10 ate commercial message during the break. In a preferred 
though the invention is described in the context of cable embodiment, the headend transmits a plurality of alter- 
television systems, it will be appreciated that it has nate commercial message channels for use by the selec- 
application in comparable systems, such as satellite tion means. Thus, for example, a television program 
broadcasting systems and the like. viewed by a child can have toy commercials, while the 
Viewers of commercial television are well aware that 15 same program viewed by an adult can have commer- 
a typical television channel contains television pro- cia i s for items such ^ automobiles, air transportation 
grams with periodic commercial message breaks. Ad- services, and the like. In a more comprehensive system, 
vertisers sponsor television programs by purchasing the headend can transmit a plurality of television pro- 
space for their commercials during the broadcast of the channe]s each havi rio{Jic commercial mes . 
program. Although different commercials are often run 20 fe ^ ^ te]evision am hay _ 
for the same television program in different geographic . corresponding plurality of alternate commercial 
areas, there has been no way to target specific commer- ° , r , ° 1 . , J , . , 
cials to specific television viewers on a case-by-case message channels associated therewith. 
^ as j s In order to provide a return to the television program 
It would be advantageous to provide a method and 25 at the termination of a commercial message break, a 
apparatus for targeting specific commercial advertise- timer can be P™vided that allocates a specific time slot 
ments to demographically selected audiences. Such a < e -g- 15 seconds, 30 seconds, 60 seconds) for commer- 
system would enable commercial advertisements to be clal messages to be received. At the termination of the 
matched to specific television viewers, thereby more tlme slot - the system returns to the channel containing 
efficiently utilizing advertising budgets. It would be 30 the television program. Other means, such as commer- 
further advantageous to maintain real-time records of cial message break start and stop data signals, can be 
demographic characteristics of particular television provided to alert the selection means to switch from the 
viewers and the programs they watch, for subsequent television program channel to an appropriate commer- 
retrieval and analysis. cial channel, and back. Such data signals can be trans- 
The present invention provides such a method and 35 mitted by the headend as "tag information" on a sepa- 
apparatus. rate data path in a conventional manner. 

SUMMARY OF THE INVENTION . In order to accommodate a plurality of television 
viewers watching a television together, means are pro- 

The present invention provides a cable television vided for prioritizing the demographic characteristics 

system or the like for broadcasting different commercial 40 0 f a group of viewers. The selection means is responsive 

messages to different demographically targeted audi- to the prioritizing means for providing a commercial 

ences. A headend transmits television signals. Means are message based on the prioritization, 

provided for identifying demographic characteristics of In order to prov ide market research functions and 

a television viewer. Selection means, responsive to the enab]e accurate billing of advertisers for commercials 

identifying means, provide a particular commercial 45 presented t0 v i ewer s, means are provided for storing 

message transmitted from the headend based on the data mdicative ofcMs xrvices xlccted by viewcrs ^ 

demographic characteristics. commercial messages provided by the selection means 

Viewer demographic types can be determined in a fof sub t retrievaJ ^ ^ is b the headend . 
variety of ways. In one approach, a user demographic ^ nt invention ^ ides subscriber 
key on a handheld remote control is actuated by the 50 , r r . , *\ . . . K \_ 
viewer before television channel selection is made This ^ m J? T Use m rCCC, ™n ? televlS, ° n 1 serv ? ces or th , e 
demographic type is then stored in the memory of a ^ ^ eans a f e P r ™ ded for receiving television signals 
cable television converter or the like. The converter >" cludui g a flrst television channel comprising televi- 
will thereby know what demographic type is viewing a «on programs with periodic commercial message 
television program. 55 breaks and a plurality of additional television channels 
Alternate methods of determining individual viewer comprising commercial messages. Tuning means, cou- 
demographic types include household survey or diary P led to the receiving means, provide a selected channel 
information, known address/neighborhood locations or for viewing. Means are provided for identifying demo- 
known ethnic locations. All of these approaches allow graphic characteristics of a television viewer. A deter- 
for demographic information to be programmed into a 60 mination is made as to when a commercial message 
converter on an individual basis during installation of a break is about to occur on the first television channel, 
cable television converter or, by known techniques and selection means actuate the tuning means to provide 
from a cable system headend that transmits data to an a particular commercial message channel for viewing 
addressable converter. during a commercial message break, based on the view- 
In one embodiment of the present invention, the hea- 65 er's demographic characteristics. Means are further 
dend transmits a first television channel comprising provided for actuating the tuning means to return to the 
television programs with periodic commercial mes- first television channel at the conclusion of a commer- 
sages, and a second television channel comprising alter- cial message break. 
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A remote control is provided for use with a cable rrtff DFsrRTPTinK of thf nR awinhs 

television converter, which comprises selector switches BRIEF DESCRIPTION OF THE DRAWINGS 

for enabling a user to remotely control various func- FIG. 1 is a block diagram of a cable television con- 

tions including channel selection. In accordance with verter for use in connection with the present invention; 

the present invention, the remote control comprises 5 FIG. 2 is a plan view of a handheld remote control 

means for enabling a user to input demographic data to that a viewer can use to input demographic information; 

the converter. Such means can comprise a plurality of FIG. 3 is a flowchart of a software routine used by 

switches for entering information indicative of the sex the converter of FIG. 1 in connection with the present 

and age of the user. invention; 

In another embodiment, the present invention pro- 10 FIG. 4 is a flowchart of a routine used by the con- 

vides a cable television system or the like with the op- verter of FIG. 1 for storing command and demographic 

tion of commercial free television programming. A data entered by a viewer and prioritizing demographic 

headend transmits television signals, including a first data of a plurality of viewers watching a television 

television channel comprising television programs with program together; 

periodic commercial messages and a second television 15 FIG. 5 is a block diagram of headend apparatus in 
channel comprising a non-commercial program (e.g., accordance with the present invention; 
music, fine arts, or the like). Alternately, the second FIG. 6 is a block diagram showing an alternate em- 
channel can provide another television program (e.g., a bodiment of headend apparatus in accordance with the 
sports event) the viewer wants to watch intermittently P™* invention; and 

during commercial breaks in the primary show being 20 7 15 * T b ' OC t k dla S ram of a r ° u j me US f by the 

viewed. Means are provided for receiving the first converter of FIG. 1 to retrieve stored data and transmit 

channel from the headend, and determining when a 11 t0 tne neadend - 

commercial message break is about to occur on the first DETAILED DESCRIPTION OF THE 

television channel. Means responsive to the determining ^ INVENTION 

means receive the second channel instead of the first yhe t ^ of particu . 

channel during the duration of the commercial message ^ co £ mercial advertisements to television viewers 

r f a ' , _ . . , , , . , ,., having particular demographic characteristics, and the 

Headend apparatus is provided for broadcasting dif- sub u £ nt retrieval of market research data iden tifying 

ferent commercial messages to different demography 3Q the programs selected and commercials viewed by par- 

cally targeted cable television audiences. Means are dcular demographic types . The invention is disclosed in 

provided for transmitting a television signal containing connec tion with a cable television system. It should be 

television programs and periodic commercial message apprec iated, however, that the invention is equally ap- 

breaks on a first television channel on a cable distnbu- phcabIe to other television broadcast syste ms as will be 

tion network. A library of recorded television commer- 35 apparent to those skiUed in the art . 

cials is provided for playback under the control of a In accordance with the invention, a cable television 

system controller. Means concurrently transmit, on converter tunes automatically to a predefined commer- 

separate television channels on the cable distribution cia] channel when a commercial message break is about 

network, a plurality of different television commercials to in a television program being viewed. The 

played back under the control of the system controller 40 predefined commercial channel contains commercials 

during a periodic commercial message break. targeted to the viewer demographic type. The tuning 

The headend apparatus can further comprise means f rom ^ program channel to the commercial channel is 

for storing data indicative of demographic characteris- oruy minimally noticeable by the viewer. For example, 

tics of a cable television subscriber. Means responsive to tbe tuning can occur during the vertical blanking inter- 

the stored data direct subscriber apparatus serving the 45 va ] of the television program signal. The implementa- 

subscriber to tune to a designated channel, during a ti on D f control functions during the vertical blanking 

periodic commercial message break, for receipt of a interval is well known in the art, and circuitry for ef- 

television commercial targeted to the subscriber. Means fecting a tuning change during the vertical blanking 

are provided for recording data indicative of commer- interval will be apparent to those skilled in the art. By 

cials transmitted on the cable distribution network from 50 enabling different converters to tune to different com- 

the library, and for billing advertisers based on this data. mercial channels, one viewer demographic type using 

A method is provided for broadcasting different com- on e converter might see a commercial for automobiles 

mercial messages to demographically different televi- while another viewer using a similar converter could 

sion audiences. A first channel is transmitted, contain- see an advertisement for toys during the same commer- 

ing television programs and periodic commercial mes- 55 cial break. 

sages. A second transmitted channel contains alternate FIG. 1 illustrates, in block diagram form, a converter 

commercial messages. Demographic characteristics of a 10 used in connection with the present invention. An 

viewer are identified, and commercial messages are RF input signal, comprising a plurality of television 

selectively provided from the first or second channel, program channels and commercial message channels, is 

depending upon the demographic characteristics. A 60 input at terminal 12 from a cable system headend. The 

plurality of channels containing alternate commercial input signal is coupled, via splitter 16, to a tuner 18 that 

messages may be transmitted, wherein commercial mes- is used to tune to a particular television program chan- 

sages are provided selectively from the first, second or nel or commercial channel under the direction of micro- 

an alternate channel depending on the demographic processor 30. The output of tuner 18 is coupled via 

characteristics identified. The demographic data can be 65 splitter 20 to a conventional descrambler 24, which 

received from the television viewer, and prioritized outputs television program signals to a viewer's televi- 

where a plurality of television viewers are watching a sion set (or other video appliance, such as a VCR) via 

television together. terminal 14. An AM data receiver 22 receives "tag 
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information" carried on a particular television channel the converter at any given instant. This implementation 
and inputs the information to microprocessor 30. FM provides a dynamic system where the viewer demo- 
data receiver 26 receives other information from the graphics can change at any time. In addition, multiple 
headend (i.e., descrambler authorization data) for input viewer data and/or demographic types can be entered 
to microprocessor 30. The use of AM and FM data 5 and stored in the converter. A "delete" button can be 
receivers in cable television converters for retrieving provided to tell the system that a particular demo- 
tag information and addressable data is well known. graphic type has left the viewing area. Prioritization of 
Operational software for converter 10 is contained in multiple viewers for use in selecting appropriate corn- 
ROM 32. Existing cable television converters, such as mercials is handled as described below in connection 
the DP5/DPV5/DPBB converters and the DP7 family 10 w j t h FIG. 4. 

of converters manufactured by the Jerrold Division of Alternate methods of identifying viewer demo- 
General Instrument Corporation can be upgraded to graphic types include a passive approach, relying upon 
implement the present invention by interchanging the inage recognition technology to determine what 
ROM chip contained in the converter with a new ROM viewer or viewers are watching television at any given 
device containing additional software. 15 time . Dem ographic types can also be identified using 

A serial number PROM 34 in converter 10 contains a household survey or diary information, known address- 
unique code identifying the converter to the headend /neighborhood locations or known ethnic locations, 
enabling the converter to be addressed on an individual Information determined by such techniques is trans- 
basis. RAM 36 is the operating memory for micro- ferred imo RAM 36 of converter 10 on m individua i 
processor 30, and in accordance with the present inven- 20 basis „ a technician falling the converter, or via a 
ion stores data indicative of demographic character- comrnunication from the cable tem headend which 
tics of a viewer or viewers using the converter at any , n . ™. . . . 

„.,,,, . f , _ . ,. . J r addresses converter 10, via FM data receiver 26, to 

given time. RAM 36 may also store data indicative of , , , , ,. . , . , „ 

~, , , - • . i »u ui , . , download the demographic data. This approach allows 

the television channels or other cable services selected . . . „ , 7 . . • . 

by particular demographic types. This data can be ap- 25 f e headend t0 f u P date and mod ' f y chan « es ln househoId 

pended with date and time information by microproces- demographics for particular subscribers, 

sor 30, to enable subsequent cross-referencing of chan- f head f d ln accordance with the present invention 

nels selected by viewers to the programs shown on the trans ™ ts television program channels to converter 10 

channel at the time of selection. to S ether ™ th se P arate channels containing commercial 

LED display 38 outputs the television channel num- 30 messa S es G-e- advertisements). Information alerting the 

ber to which the converter is tuned by a viewer. IR converter as to when a commercial message break is 

receiver 40 receives data transmitted by a handheld about to occur durm S a television program, and identi- 

remote control for input to microprocessor 30. Keypad fvin g the channels containing commercials for different 

42 enables users to input channel selection and other demographic audiences, is transmitted by the headend 
information to the converter directly without the use of 35 in the form of information on the particular televi- 

a handheld remote control. s,on P r ogram channel to which the converter is tuned. 

A remote control 120 for use with converter 10 is ^ u 8 information is detected by AM data receiver 22 
illustrated in FIG. 2. Data are transmitted from the and ln P ut to microprocessor 30, which forces tuner 18 
front end 122 of remote control 120 using an infrared or to tune m the appropriate commercial message channel 
equivalent remote data path. A plurality of conven- 40 at the appropriate time. The AM tag data detected by 
tional function buttons 132 and channel selection but- receiver 22 is carried on the audio portion of the televi- 
tons 134 are provided. In accordance with the present slon program signal in a conventional manner. Alter- 
invention, a plurality of switches 124, 126, 128, 130 is natelv > the tag data «n be included in the vertical 
provided to enable a user to input demographic data to blanking interval using known techniques to alert con- 
converter 10. For example, switches 124 and 126 can be 45 verier 10 (via microprocessor 30) that a commercial 
provided to indicate that the viewer is an adult male or break is about to occur. 

female, respectively. Switches 128 and 130 can be pro- Once converter 10 has been alerted that a commercial 
vided to indicate that the viewer is a male or female message break is imminent, it identifies the demographic 
child, respectively. Other demographic information can characteristics of the current viewer from data stored in 
alternately be provided via switches 124-130, or by the 50 RAM 36. The converter software stored in ROM 32 
provision of additional demographic switches on re- then initiates an automatic channel change during a 
mote control 120. Equivalent switches can also be pro- vertical blanking interval to the specific commercial 
vided on the converter itself, as part of keypad 42. In an message channel to which the demographic characteris- 
alternate embodiment, a user code is entered on the tics correspond. This channel is maintained for either a 
numeric keys of the remote control or converter to 55 pre-established fixed time period (e.g., 15, 30, 45 sec- 
identify the demographic type of the viewer before any onds, etc.) by a timer operatively associated with micro- 
commands are executed. Use of a user code would processor 30, or until a "return to original channel" 
expand the number of demographic types allowable, but instruction is detected by the converter through tag 
may require additional keys to be actuated to initiate a data transmitted by the headend. After the commercial 
converter response. 60 break, the converter returns back to the original televi- 
In operation, a viewer is required to press a demo- sion program channel during a vertical blanking inter- 
graphic key on the remote control 120 (or on keypad val. Switching back and forth between television pro- 
42) before any other key is depressed to select a channel gram and commercial message channels during the 
or other converter function. The demographic data vertical blanking interval minimizes any visible inter- 
(and any other relevant data, such as data indicative of 65 ruption to the television viewer. The software for ac- 
the converter function selected) are then stored in complishing the retuning of tuner 18 contains program 
RAM 36 so that the converter knows what demo- instructions that will be apparent to those skilled in the 
graphic type is watching the television associated with art. 
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In the event separate commercial message channels The routine of FIG. 4 commences at box 180, and 
are not being transmitted by the headend, or if commer- control is passed to box 182 where a determination is 
cials already included on the television program chan- made as to whether a command initiated by a viewer is 
nel being viewed are appropriate for the viewer, the being input to the converter. Once an incoming corn- 
converter maintains the current television program 5 mand is detected (e.g., from a viewer's remote control), 
channel during commercial breaks and no automatic control passes to box 184 where data indicative of selec- 
tuning to alternate commercial message channels oc- tions made by a viewer, including demographic data 
curs. The system of the present invention is compatible pertaining to the viewer(s), are received. At box 186, a 
with existing systems, and enables "cable-ready" televi- determination is made as to whether demographic data 
sions viewing cable television channels directly (with- 10 were received for more than one viewer. If so, the 
out a converter) to receive the commercials carried on highest priority viewer is identified at box 188. The 
the television program channel being viewed. viewer demographic type of the highest priority viewer 

A flowchart illustrating the operation of the con- is stored in RAM 36, as indicated at box 190. Then, at 
verter software contained in ROM 32 in a preferred box 192, the actual command (e.g., change of channel) 
embodiment is provided in FIG. 3. The software rou- 15 entered by the viewer is executed. Control then returns 
tine begins at box 150, which passes control to box 152 to box 182 where the process repeats, 
where tag information transmitted by the system hea- In the event the cable television system operator 
dend is read. The tag information defines if and when a wants to provide market research data to advertisers 
commercial is about to occur, how long it will last, and concerning, e.g., demographic information, channels/- 
which channel the converter should tune to given the 20 programs viewed, pay-per-view purchases, etc., RAM 
viewer demographic type. If the tag information does 36 will also store cumulative data indicative of the se- 
not indicate that a commercial is about to occur, as lections made by users via the remote control or con- 
determined at box 154, the converter stays tuned to the verter keyboard. As indicated at box 190, microproces- 
present television program channel, as indicated at box sor 30 will append this data with the date and time of 
156. Otherwise, control passes to box 158 where a deter- 25 the selections so that the actual programs or other ser- 
mination is made as to whether demographic commer- vices selected can be identified. The date and time infor- 
cial options are available. If not, the converter remains mation can be received by microprocessor 30 from the 
tuned to the present channel as indicated at box 160. headend via FM data receiver 26. Information concern- 

If the converter contains data indicative of a viewer's ing other converter functions, such as the position of 
demographic characteristics, and the headend is provid- 30 A/B switches for bypassing the converter or viewing 
ing a channel for commercials targeted to such a off-air programs, can also be determined and stored. A 
viewer, the targeted commercials will be provided to routine for the subsequent transmission of this market 
the viewer. At box 162, the viewer demographic type research data to the headend is shown in FIG. 7. 
stored in RAM 36 is determined. At box 164, the length The routine of FIG. 7 commences at box 200, and at 
of the impending commercial message break is deter- 35 box 202 a determination is made as to whether the con- 
mined from the tag information transmitted by the hea- verter 10 (FIG. 1) has received a data retrieval tag 
dend. At box 166, the converter determines which instruction from the headend. Such an instruction 
channel to tune to. in order to receive the targeted com- would be sent down the cable and received by FM data 
mercials. The channel information is either defined by receiver 26. Upon recognition of a data retrieval tag in 
the tag information received from the headend, or has 40 the FM data stream addressed to the particular con- 
previously been stored in converter memory 36. Then, verter, microprocessor 30 determines whether any per- 
at box 168, the converter tunes to the correct channel tin en t data are stored in RAM 36, as indicated at box 
for the commercials to be received. This is accom- 204. If not, control returns to box 202 until a data re- 
plished by a signal from microprocessor 30, that directs trieval tag instruction is received and relevant data are 
tuner 18 to tune in the appropriate commercial message 45 found in RAM 36. 

channel. If relevant market research data have been stored in 
Tuner 18 remains tuned to the commercial message RAM 36, control passes from box 204 to box 206 where 
channel for a preset length of time (i.e., the length of the the data are retrieved from RAM 36. As indicated at 
commercial break) or until new tag information is re- box 208, the data are then transmitted to the headend 
ceived from the headend directing the converter to 50 via return path 44, which may be any conventional 
retune to the original television program channel. The return path well known in the art. For example, if a 
return to the original channel is effected at box 172. telephone return path is used, return path 44 will in- 
Control then returns to box 152 where the process re- elude a modem to modulate the data for transmission 
peats. over a telephone line. In a two-way cable system, an RF 
In the event that a group of television viewers are 55 return path may be used. At box 210, a determination is 
watching a television together, and more than one made as to whether all of the pertinent market research 
viewer demographic type is present, a hierarchy /pri- data have been transmitted to the headend and whether 
ority decision is made by the converter software to the transmission has been verified. If not, the data trans- 
determine the dominant demographic type present. The mission repeats until it is complete. At box 212, the 
prioritization method can be based, for example, upon a 60 accumulated market research data are cleared from 
weighted average of all the viewers present. Alter- RAM 36, although the current viewer demographic 
nately, the viewer who initiated the present channel data will remain so that a user will not have to re-enter 
decision, or the person who makes household buying this information after the market research data have 
decisions can be given priority. The flowchart of a been retrieved. Control then returns to box 202 to await 
routine for receiving data input by a viewer (including 65 the next request by the headend for the retrieval of 
demographic data), dealing with a plurality of viewers, market research data from the converter, 
and storing said data for possible later retrieval and One embodiment of a cable television system hea- 
analysis is provided in FIG. 4. dend that can be used to implement the present inven- 
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tion is shown in block diagram form in FIG. 5. The 
components for handling commercial message sequenc- 
ing and insertion are depicted in box 50. In this embodi- 
ment, the cable system operator, who controls the hea- 
dend, is provided with the capability to insert commer- 5 
cials in the commercial break portions of programs 
carried on the main television program channel, and 
also for providing a plurality of alternate commercial 
channels targeted to different demographically defined 
audiences. 10 

A system controller 58, which comprises a computer 
such as a personal computer or mini computer, provides 
overall control of a commercial inserter 60, commercial 
sources 62a-n, and a commercial interface matrix/con- 
troller 64. Controller 58 also provides billing and traffic 15 
data to a billing and traffic computer 56 that is shared 
with other conventional headend components (not 
shown) for billing subscribers and advertisers, and man- 
aging the cable television services provided. 

Commercial inserter 60 receives commercials from 20 
one or more commercial sources 62a-n which may, for 
example, comprise VCRs, video disc players, or the 
like, containing recorded commercial messages. The 
commercial inserter can serve a plurality of television 
program channels, each fed by a respective program 25 
source Sla-n. Each program source carries television 
programs having periodic commercial message breaks. 
Commercials are inserted during the commercial mes- 
sage breaks by commercial inserter 60, and output on 
the same television channel that carries the program 30 
source via a scrambler /encoder 66a and television mod- 
ulator 68a for each television program channel. The 
scrambler/encoder scrambles premium program signals 
as necessary, and encodes the program signal with the 
tag information necessary to identify the commence- 35 
ment of a commercial break, etc. The channel signal 
output from television modulator 68a is coupled to the 
cable television distribution system at terminal 74 via a 
coupler 72, in a conventional manner. 

Commercial interface matrix/controller 64 enables 40 
the cable system operator to provide a plurality of alter- 
nate commercial message channels, each of which is 
scrambled and encoded as necessary by scrambler/en- 
coders 666-/1, which in turn output the commercial 
message channels to television modulators 68b-n. Each 45 
television modulator outputs the commercial messages 
input to it on a different channel. The channels are 
coupled to the cable television distribution network via 
couplers 72 for output on terminal 74. 

The individual commercials contained in an alternate 50 
commercial message channel are retrieved by commer- 
cial interface matrix/controller 64 from commercial 
sources 62a-h. Where, for example, an alternate com- 
mercial message channel is provided for children, com- 
mercials for various toys can be retrieved by controller 55 
64 from commercial sources 62a-n. 

System controller 58 provides overall control of the 
headend apparatus. For example, it controls the state of 
commercial inserter 60 to select between a television 
program from program source 52a and a commercial 60 
message from commercial sources 62a-n. Commercials 
from sources €2a-n are available on a time shared basis, 
under the control of software contained in the system 
controller. In this manner, for example, the same com- 
mercial can be provided on the main television program 65 
channel (via commercial inserter 60) and on an alternate 
commercial message channel (via commercial interface 
matrix/controller 64) at different time slots within the 
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same commercial break. For example, the same com- 
mercial can be run on one channel during the first 15 
seconds of a 45 second commercial break, and on an- 
other channel during the last 15 seconds of the same 
commercial break. The ordering of various different 
commercials within a commercial break, and the selec- 
tion of those commercials is ultimately controlled by 
system controller 58 in accordance with sequencing 
rules established by the cable system operator. 

As noted above, tag information necessary, e.g., for 
the converter to determine that a commercial break is 
about to occur on a given channel, is "encoded" on 
television channels via scrambler encoders 66a-n. This 
information is included either as AM data in the audio 
portion of the television signal, or as vertical blanking 
interval data. Specific tag data and timing of such data 
are relayed to scrambler/encoders 66a-« via system 
controller 58. The tag information can be encoded with 
or without signal scrambling. 

An FM data modulator 70 is provided to enable the 
headend to download information, such as demo- 
graphic information, to subscriber converters. This 
information can be transmitted on an individual basis 
where it is addressed to a particular converter, globally, 
or by groups of converters assigned to subscribers hav- 
ing similar demographic characteristics. 

Billing and traffic computer 56 allows for accurate 
commercial tracking and advertiser billing. This com- 
puter, through a clock in system controller 58, records 
when various commercials were run, with data indica- 
tive of the channel on which each commercial was run 
and for how long. Feedback to advertisers can also be 
provided on who and how many people viewed a par- 
ticular commercial, through the use of an optional re- 
turn path 44 provided in converter 10 (see FIG. 1). 
Optional return path 44 comprises an output from mi- 
croprocessor 30 that communicates with the headend 
via the cable television network (where a two-way 
system is provided) or on another return path, such as a 
telephone line. Return paths for providing two-way 
communication between cable television headends and 
subscriber converters are well known in the art. 

FIG. 6 illustrates an alternate headend embodiment, 
wherein commercial interface matrix/controller 64 is 
eliminated. A plurality of television program channels 
54 are coupled, via a coupler 72, for output on the cable 
television distribution network at terminal 74. The tele- 
vision program channels contain television programs 
and periodic commercial messages. Alternate commer- 
cial messages are provided on a plurality of commercial 
message channels that are also coupled to the cable 
television distribution network. Each alternate com- 
mercial message channel receives commercials from an 
associated commercial player 80, 82, 84, 86 controlled 
by system controller 58. The commercial players can 
comprise, for example, video disc players equipped 
with interchangeable video discs each containing a 
plurality of commercials. Each player can retrieve and 
play back any of the commercials from a video disc on 
a random access basis. The system operator programs a 
set of commercials for playback on each commercial 
message channel in any order desired. In practice, the 
system operator will create sets of commercials to fill 
commercial breaks of different time periods and 
grouped to target different demographic audiences. 

Television signals containing the commercials are 
output from each player to scrambler/encoders 90, 92, 
94, 96, respectively. The scrambled and/or encoded 
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commercial signals are input to television modulators 
100, 102, 104, 106, respectively, where the commercials 
from each player are output on a different television 
channel. These television channels form the alternate 
commercial message channels retrieved by subscriber 5 
converters as described above. The commercial mes- 
sage channels are coupled to the cable television distri- 
bution network by couplers 72. 

In another embodiment of the present invention, a 
"commercial killer" option can be provided. In this 10 
embodiment, one of players 80, 82, 84, 86 will play a 
non-commercial program (e.g., music, fine arts, etc.) 
instead of commercials. A subscriber converter can be 
programmed to tune to the non-commercial channel 
during all commercial breaks, and then return to the 15 
regular television program channel upon the comple- 
tion of each commercial break. With this feature, sub- 
scribers can eliminate all commercial messages from 
their television viewing. Alternately, a subscriber con- 
verter can be programmed to tune to another program 20 
channel (selected by the viewer) during commercial 
breaks occurring on the primary channel being viewed. 
Thus, for example, a viewer can watch portions of a 
second sports event during the commercial breaks in an 
event of primary interest, 25 

Demographic programming is also available using 
the apparatus of the present invention, allowing total 
program material (including programs and commer- 
cials) to be automatically selected by the converter 
based on a viewer's demographics. A viewer would 30 
tune to a certain channel number, and all programming 
for the viewer would be provided by the converter 
automatically tuning to program and commercial chan- 
nels according to demographics or pre-established 
viewer preferences. 35 

It will now be appreciated that the present invention 
provides a system, apparatus, and method for broad- 
casting different commercial messages to different de- 
mographically targeted audiences. Although the inven- 
tion has been described in connection with various pre- 40 
ferred embodiments, those skilled in the art will recog- 
nize that various modifications may be made thereto. 
For example, the invention is not limited to use in a 
cable television system, and can be utilized in connec- 
tion with other television transmission schemes. It is 45 
intended that the following claim language be read in its 
broad sense to cover all such equivalent schemes. 

I claim: 

1. Apparatus for use in receiving television services, 
comprising: 50 

means for receiving television signals including a first 
television channel comprising television programs 
with periodic commercial message breaks and a 
plurality of additional television channels compris- 
ing commercial messages; 55 

tuning means coupled to said receiving means for 
providing a selected channel for viewing; 

means for identifying demographic characteristics of 
a television viewer; 

means for determining when a commercial message 60 
break is about to occur on said first television chan- 
nel; 

means for prioritizing the demographic characteris- 
tics of a plurality of television viewers currently 
watching a television together; and 65 

selection means, responsive to said determining 
means and said prioritizing means, for actuating the 
tuning means to provide a particular commercial 
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message channel for viewing during a commercial 
message break, based on said prioritization of de- 
mographic characteristics. 

2. Apparatus in accordance with claim 1 further com- 
prising: 

remote control means for enabling a viewer to trans- 
mit demographic data to said identifying means. 

3. Apparatus in accordance with claim 1 further com- 
prising: 

means for storing data indicative of commercial mes- 
sages provided by said selection means for subse- 
quent retrieval and analysis by a headend. 

4. Apparatus in accordance with claim 1 further com- 
prising: 

means for enabling a viewer to input demographic 
data to said identifying means. 

5. Apparatus in accordance with claim 1 further com- 
prising: 

means for actuating said tuning means to return to 
said first television channel at the conclusion of a 
commercial message break in the event said selec- 
tion means has provided a commercial message 
from a channel other than said first television chan- 
nel during the break. 

6. A television system for providing substitute televi- 
sion programming during commercial breaks in a pri- 
mary program, comprising: 

a headend for transmitting television signals, includ- 
ing a first television channel comprising television 
programs with periodic commercial messages and 
a second television channel comprising another 
viewer selected backup program; 

means for receiving said first channel from said hea- 
dend; 

means for determining when a commercial message 
break is about to occur on said first television chan- 
nel; and 

means responsive to said determining means for re- 
ceiving said second channel instead of said first 
channel during the duration of the commercial 
message break. 

7. Headend apparatus for broadcasting different com- 
mercial messages to different demographically targeted 
television audiences, comprising: 

means for transmitting a television signal containing 
television programs and periodic commercial mes- 
sage breaks on a first television channel on a televi- 
sion signal distribution network; 

a library of recorded television commercial for play- 
back under the control of a system controller; 

means for concurrently transmitting, on separate 
television channels on said distribution network, a 
plurality of different television commercials played 
back under the control of said system controller 
during a periodic commercial message break for 
selective receipt of different commercials by a uni- 
verse of viewers; 

means for recording data indicative of the number of 
viewers that are provided with a given commercial 
transmitted on said distribution network from said 
library; and 

means responsive to said recording means for billing 
an advertiser based on said data. 

8. Headend apparatus in accordance with claim 7, 
further comprising: 

means for storing data indicative of demographic 
characteristics of one of said viewers; and 



means, responsive to data stored in said storing 
means, for directing viewer apparatus serving said 
one of said viewers to tune to a designated channel 
during said periodic commercial message break for 
receipt of one of said plurality of different televi- 5 
sion commercials targeted to the viewer. 

9. A system for automatically selecting, television 
programs and commercials for a viewer, based on data 
pertaining the viewer, comprising: ]q 

means for storing data indicative of predetermined 
characteristics of said viewer; 

means, responsive to said stored data, for causing a 
television signal receiver to select from a plurality 

15 
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of programs a television program targeted to view- 
ers having said characteristics; and 

means, responsive to said stored data during a com- 
mercial message break of said selected television 
program, for directing said television signal re- 
ceiver to select, from a plurality of commercials, a 
television commercial targeted to viewers having 
said characteristics. 

10. Apparatus in accordance with claim 5 wherein 
said actuating means comprises: 

a timer for actuating the return to said first television 
channel a predetermined time period after a com- 
mercial message break has commenced. 
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